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Assessment  and  evaluation  are  central  to 
educational  reform  initiatives  all  over 
i the  world.  Not  only  are  countries, 
I provinces  and  states  relying  on  large- 
scale  assessments  as  measures  of  the  progress 
and  success  of  their  initiatives,  but  classroom 
assessment  has  become  a major  part  of  the 
agenda  for  improving  student  learning. 

The  changes  that  are  occurring  in  classroom 
assessment  are  not  just  superficial  tampering. 
They  represent  major  shifts  in  thinking  about 
learning,  about  accountability,  about  schools 
and  about  teaching.  Classroom  assessment 
reform  is  much  more  than  using  a variety  of 
new  techniques.  It  means  teachers  using  their 
judgments  about  children’s  knowledge  or 
understanding  to  improve  the  teaching  process 
and  to  determine  what  to  do  for  individual 
children.  It  means  providing  descriptions 
of  student  performance  and  sharing  the 
decision-making.  It  means  making  assessment 
criteria  visible  and  bringing  parents  and 
students  into  the  process.  It  means  making  a 
fundamental  shift  in  thinking  about  how  and 
why  assessment  and  teaching  are  integrally  con- 
nected. It  means  rethinking  curriculum  and 
curriculum  coverage. 

Teachers  routinely  tell  us  that  “assessment  is 
the  hardest  part”  of  their  work.  In  this  issue  we 
have  tried  to  uncover  some  of  the  reasons  and 
offer  some  direction.  Changing  classroom 
assessment  is  a political,  emotional  and  techni- 
cal undertaking.  The  articles  in  Section  1 frame 
some  of  the  difficulties  that  are  inherent  in 
changing  the  purposes  and  approaches  to  class- 
room assessment.  Section  2 provides  a number 
of  principles  and  standards  that  provide  refer- 


ence points  for  decisions  about  the  nature 
and  adequacy  of  classroom  assessment  policies 
and  practices.  In  Section  3,  the  articles  provide 
some  insights  into  approaches  that  teachers 
are  beginning  to  use  in  their  classrooms.  Finally, 
Section  4 poses  some  challenges  to  all  of  us 
to  think  about  how  classroom  assessment 
can  and  might  change,  as  we  continue  on  the 
journey  of  improving  learning  for  students 
in  our  schools. 

In  this  issue  we  have  tried  to  give  voice  and 
meaning  to  classroom  assessment.  Even  with 
paradoxes  and  areas  of  uncertainty,  assessment 
makes  a profound  difference  to  life  in  schools 
and  to  student  learning  and  improvement.  We 
realize  that  there  is  no  perfect  answer,  especial- 
ly when  our  day-to-day  life  is  characterized  by 
so  many  fundamental  educational  reforms. 
However,  we  also  realize  that  enhancing  our 
understanding  of  assessment  and  improving  our 
classroom  assessment  practices  come  from 
making  small  changes  that  work. 

It  is  our  belief  that  inquiry  fosters  collabora- 
tion and  collegiality,  questioning  and  curiosity, 
reflection-in-practice  and  the  search  for  better 
alternatives.  In  such  a context  there  is  an  on 
going  commitment  to  valuing  curiosity,  mutual 
respect,  and  support  among  and  between  indi- 
viduals. In  other  words,  there  is  a willingness  to 
try  new  ideas  and  practices;  there  is  a determi- 
nation to  remain  open  to  the  unforeseen  and 
the  unexpected. This  is  precisely  what  we  need 
as  we  continue  to  learn  about  and  to  improve 
classroom  assessment. The  articles  in  this  issue 
provide  a background  for  open  and  informed 
public  conversations  and  further  inquiry  about 
what  works  best. 


Lorna  Earl  and  Clay  Lafleur 
Guest  Editors 
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Tl  cachcrs  will  be  expected  to  be  far 
more  assessment  literate  in  the  future 
than  tliey  are  today  or  have  been  in  the 
past.  Virtually  every  set  of  standards  of 
teacher  comjjctence  developed  recently  holds 
the  expectation  that  teachers  will  be  compe- 
tent in  assessment. 

This  trend  aligns  requirements  for  the 
teaching  profession  with  what  we  have  long 
known  to  be  the  reality  of  assessment  life  in 
classrooms.  Teachers  can  spend  a third  of  their 
professional  time  or  more  involved  in  assess- 
ment related  activities  (Herman  & Dorr- 
Bremme,  1982;  Crooks,  1988;  and  Stiggins  & 
Conklin,  1992).  An  appropriate  level  of  assess- 
ment com|5etence  is  required  to  do  this  job 
well,  dhe.se  new  standards  ot  professional 
excellence  place  significant  new  pressure  on 
colleges  of  education  to  prepare  their  gradu- 
ates to  be  assessment  literate — a challenge 
thev  have  long  failed  to  meet  (Noll,  1955; 
Boeder,  1972;  Gullickson,  1984;  Shafer  & 
Lissitz,  1987;  and  Stiggins  & Conklin,  1992). 

Until  higher  education  responds  to  this 
demand,  local  school  district  staff  develop- 
mcTit  |n'olessionals  will  continue  to  face  the 
challenge  of  filling  this  long-standing  gap  in 
assessment  literacy. 

Assessment  Literacy  Defined 

Teachi-rs  and  administrators  who  arc  assess- 
ment literate  understand  the  difference 
between  sound  and  unsoutid  assessment, 
ewaluation  and  communication  practices. 
Those  w ho  are  assessment  literate; 

^ understand  what  assessment  methods  to 
use  in  order  to  gather  dependable  informa- 
tion about  student  achievement 
^ communicate  assessment  results  effcctivelv, 
whether  using  rc|iort  card  grades,  test 
scores,  |iortfolios  or  conferences 


^ understand  how  to  use  assessment  to  maxi- 
mize student  motivation  and  learning  bv 
involving  students  as  full  partners  in  assess- 
ment, record  keeping  and  communication 

What  Teachers  Need  to  Know 

l^rofessional  development  in  classroom  assess- 
ment must  build  a deep  understanding  of  the 
difference  betw'een  sound  and  unsound  assess- 
ment and  a complete  understanding  of  how  to 
use  assessment  as  a teaching  tool. This  translates 
into  the  following  six  classroom  assessment 
competencies  for  educators  (Stiggins,  2001 ). 

First,  they  must  understand  the  full  range  of 
users  and  uses  of  assessment.  Users  are  found 
in  the  classroom,  in  instructional  support  roles 
and  in  the  ranks  of  policy  makers.  Different 
users  in  different  contexts  need  different 
information  about  student  achievement  in  dif- 
ferent forms  and  at  different  times  to  do  their 
jobs.  No  single  assessment  can  meet  everv- 
one’s  needs.  Assessment  literate  educators 
understand  and  appreciate  those  differences. 

Second,  educators  must  be  crystal  clear 
about  the  achievement  targets  that  they  want 
their  students  to  hit.  Different  forms  of 
achievement  (i.e.,  mastery  of  content  knowl- 
edge, reasoning  proficiency,  performance 
skills  and  product  creation  proficiencies) 
require  the  application  of  different  modes  of 
assessment.  Assessment  literates  know  that  the 
first  question  thev  must  answer  is,  “llViaf  do  I 
want  to  assess?”  (.)nlv  w ith  that  answer  in  mind 
can  they  determine  how  best  to  assess  it. 

rhird,  they  must  be  prepared  to  use  the  full 
range  of  as.sessmcnts  to  track  student  achieve- 
ment, including  selected  resjronse,  essav,  per- 
formance, and  personal  communication-based 
assessment  formats. Teachers  must  know  how 
to  select  an  appropriate  assessment  method  for 
their  particular  context  and  understand  when 
to  use  it  and  w hv  it  fits  best. 
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Fourth,  they  must  understand  how  to 
assemble  the  exercises  of  whatever  method 
they  choose  in  order  to  sample  student  perfor- 
mance effectively  and  efficiently.  Assessment 
literates  can  gather  just  enough  evidence  of 
student  achievement  to  lead  them  to  a confi- 
dent conclusion  without  wasting  time  gather- 
ing too  much. 

Fifth,  they  understand  the  sources  of  bias 
that  can  creep  into  each  assessment  and  they 
know'  what  specific  actions  to  take  to  prevent 
those  potential  problems  from  distorting  their 
assessment  results. 

And  finally,  assessment  literate  teachers 
understand  the  relationship  between  assessment 
and  student  motivation.  They  know  how  to 
bring  students  into  the  processes  of  assessment 
and  communicating  results,  thus  turning  these 
into  confidence-building  instructional  interven- 
tions.They  understand  that  this  kind  of  deep  stu- 
dent invoh  ement  greatly  boosts  the  chances  of 
student  success. 

Professional  Development  Options 

what  kinds  of  adult  learning  environments 
and  experiences  are  most  likely  to  help  teach- 
ers and  administrators  learn  to  design,  develop, 
and  implement  quality  classroom  assessments 
in  these  terms?  Whatever  approach(es)  we  use 
must  meet  certain  standards  of  excellence 
in  professional  development  practice.  To  be 
specific,  thev  must  provide: 

Section  1 ^ 

^ 5 ^ 
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^ an  infusion  of  new  ideas  regarding  effective 
assessment  practices — specific  things  com- 
petent assessors  need  to  know  and  do  to 
maximize  the  quality  and  impact  of  their 
classroom  assessment 

2^  opportunities  to  practice  applying  the  prin- 
ciples of  sound  assessment,  providing 
teachers  with  the  chance  to  make  newly- 
acquired  assessment  ideas  and  strategies 
come  alive  in  their  own  classrooms 
^ assessment  tactics  that  deliver  concrete 
benefits  almost  immediately  to  teachers 
anti  their  students  so  as  to  provide  positive 
motivation  to  continue  learning 
^ ways  for  educators  to  take  responsibility  for 
their  own  training — honouring  their  pro- 
fessionalism in  the  pursuit  of  excellence  in 
assessment 

llexibility  to  adjust  to  various  learning 
stvles,  training  schedules,  and  paces  of  pro- 
fessional development 

2=^  opportunities  for  collaborative  learning 
and  collegial  support  groups,  because 
adults  learn  most  effectively  when  indivi- 
duals share  the  lessons  they  have  learned 
(sujtport  groups  that  include  both  teachers 
and  administrators  can  be  important  here) 
efficiency  of  training,  minimizing  the 
amount  of  time  and  energy  practitioners 
must  invest  to  derive  maximum  benefit, 
because  resources  for  professional  develop- 
ment will  always  be  thin 

We  must  select  from  three  choices  in 
planning  professional  development  to  meet 
these  standards:  workshops,  learning  teams,  and 
individual  study. 

Workshops — Workshops  serve  to  introduce 
educators  to  the  importance  of  being  assess- 
ment literate. They  also  can  reveal  the  poten- 
tial benefits  of  adopting  new  classroom 
assessment  strategies.  Further,  we  can  use 
workshops  to  encourage  the  formation  of 
learning  teams.  But  taken  alone,  workshops 
fall  far  short  of  meeting  the  professional  devel- 
opment standards  listed  above.  Suffice  it  to  say 
that  we  cannot  rely  on  workshops  to  help 
teachers  attain  the  depth  of  understanding  they 
need  to  meet  emerging  assessment  responsi- 
bilities. Similarly,  we  must  remain  circumspect 
about  the  benefits  derived  from  hiring  exter- 
nal consultants  to  be  our  “assessment  trainers.” 


Expert  consultants  can  help  in 
planning  instructionally  relevant  assess- 
ment systems.  But  they  cannot  take  the 
journey  to  assessment  literacy  for  us. 

Expert  consultants  can  help  in  planning 
instructionally  relevant  assessment  systems. 
They  can  offer  motivational  workshops  to 
energize  a faculty  into  wanting  to  become 
assessment  literate.  They  can  even  provide 
guidance  in  mapping  the  route.  But  they  can- 
not take  the  journey  to  assessment  literacy  for 
us.  Each  individual  educator  must  take  respon- 
sibility for  getting  there  themselves.  It  takes 
that  kind  of  personal  investment  of  cognitive 
energy. 

Learning  Teams — This  is  why,  after  two 
decades  of  experimentation  with  all  options,  I 
strongly  recommend  an  assessment  literacy 
development  plan  that  relies  heavily  on  teacher 
(and  administrator)  learning  teams  as  the  basis 
of  interaction  and  growth.  A small  group  of 
three  to  seven  teachers  and  administrators 
agrees  to  meet  regularly  to  manage  and  pro- 
mote their  own  professional  development. 
They  study  together  to  fill  the  gaps  in  assess- 
ment literacy  with  the  team’s  goal  to  help  all 
members  become  as  assessment  literate  as 
possible. 

Individual  Study — However,  my  recom- 
mended strategy  relies  even  more  heavily  on 
individual  study.  Here’s  why,  and  the  reason 
is  critical:  In  between  team  meetings,  each 
team  member  must  agree  to  complete  agreed 
upon  assignments  designed  to  advance 
the  team’s  collective  knowledge  and  skills  in 
classroom  assessment.  These  assignments 
might  be  the  same  for  all  team  members.  For 
example,  they  might  read  and  reflect  on  the 
same  pieces  of  professional  literature  or  try 
the  same  assessment  strategy,  bringing  the 
lessons  they  have  learned  from  that  experi- 
ence to  share  in  the  group  meeting.  Or  team 
members  might  complete  different  assign- 
ments, learning  different  lessons,  so  meeting 
time  can  be  used  to  “jigsaw”  or  share  a variety 
of  insights  for  the  benefit  of  all.  This  is  where 


most  of  the  personal  professional  growth 
takes  place.  Think  about  the  work  that  is  to  be 
done.  We  must: 

take  time  to  read  about  and  reflect  upon 
new  assessment  ideas 

^ shape  them  into  applications  that  make 
sense  in  our  personal  classrooms 
2^  experiment  with  those  applications,  trying 
strategies,  observing  effects,  interacting 
with  students  and  drawing  inferences  about 
what  works  and  what  doesn’t 
^ collect  our  thoughts,  reactions  and  conclu- 
sions into  some  summary  form  to  share 
with  the  learning  team  at  the  next  meeting 

Assessment  Literacy  Training 

To  begin  with,  the  value  of  being  assessment 
literate  must  be  fixed  in  the  minds  of  all  educa- 
tors. Then,  interested  teachers  and  administra- 
tors must  be  given  the  resources  and 
opportunity  for  teachers  and  administrators  to 
independently,  and  as  a group,  become  assess- 
ment literate. To  stimulate  interest  within  fac- 
ulty and  staff,  a leadership  group  might  offer 
an  overview  workshop  on  the  importance  of 
high-quality  classroom  assessment. The  Assess- 
ment Training  Institute’s  free  district  assess- 
ment planning  guide,  entitled  Leadership  for 
Excellence  in  Assessment  can  help  with  this.  Any 
experienced  staff  development  specialist  can 
lead  this  self-evaluation  using  these  materials 
with  little  advanced  preparation. This  kind  of 
introductory  session  might  culminate  with  the 
announcement  that  classroom  assessment 
learning  teams  or  study  groups  will  be  formed 
for  all  interested  teachers  and  administrators. 

Organizing  Learning  Teams — Within  any 
district,  learning  teams  can  be  configured  in 
any  of  a variety  of  ways.  Groups  might  be 
formed  from  among  faculty  members  and 
administrators  within  one  building,  formed  on 
the  basis  of  grade  level  (within  or  across  levels) 
or  discipline  (math,  science,  arts,  etc.).  Princi- 
pals and  vice-principals  from  various  buildings 
might  assemble  to  create  a team  for  preparing 
to  provide  building-level  leadership  in  this 
arena.  Learning  teams  might  come  into  exis- 
tence as  opportunities  arise — for  example, 
when  an  ad  hoc  committee  is  assembled  to 
evaluate  and  consider  revising  a report  card  or 
when  a curriculum -development  team  decides 
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to  deal  with  some  underlying  assessment 
issues.  Participants  might  work  together  only 
lor  the  jreriod  of  time  needed  to  conijDlete  their 
study.  But  all  such  instances  re|irescnt  opportu- 
nities for  learning.  Some  school  districts  have 
found  it  prudent  to  also  set  up  a “Icadershijj 
study  team”  comprising  a few  key  teachers  and 
administrators  from  across  the  organization. 

Other  districts  have  issued  the  invitation  to 
team  ujr  and  ask  those  who  are  interested  to 
Idrm  teams  as  they  uish.  They  encourage 
teams  to  form  and  start  at  their  convenience, 
pacing  their  work  in  a manner  consistent  with 
the  .schedules  of  team  members.  The  Ilexibility 
of  this  professional  development  process  is 
clear.  In  any  case,  as  members  complete  an  ini- 
tial learning  team  experience,  they  can  then 
fan  out  and  lead  a team  effort  in\  olving  others. 
1 hen,  those  participants  might  do  the  same, 
and  so  on,  building  a professional  development 
pyramid.  As  time  passes,  those  not  involved  at 
the  outset  will  begin  to  sec  others  around  them 
managing  assessment  with  renewed  confi- 
dence. This  will  motivate  them  to  learn  valu- 
able assessment  lessons. 

Specifics  AhoutTeam  Work  -One  excellent 
wav  to  start  is  to  make  the  first  focus  of  learn- 
ing team  studv  to  be  a basic  assessment  text, 
such  as  Student-Involved  Classroom  Assessment 
(.Stiggins,  2001).  When  this  foundation  is  in 
place,  specific  discipline-based  apjrlications 
then  become  high  priorities.  But  whatever  the 
topic  or  reference  the  team  decides  to  centre 
on,  team  members  must  understand  from  the 
start  that  these  are  not  merely  books  to  be  read 
and  discussed.  A learning  team  is  not  a book 
club.  Rather,  these  arc  books  to  be  reatl,  reflect- 
ed Ujjon,  worked  through,  experimented  with, 
discussed,  and  culled  for  ideas  that  work  in 
each  teacher’s  individual  classroom  learning 
en\  ironmenl.  They  contain  no  prescriptions, 
oiiK  |)ossibilities  from  which  teachers 
choose  jiieces  of  clav  to  be  molded  to  fit 
each  indi\  idual  teacher’s  needs. This  is  why  we 
recommend  such  a heavv  allocation  of  time  to 
indi\  idual  studv,  classi'oom  experimentation, 
and  rellection  bet\\een  learning  team  meet- 
ings. Team  meetings  are  times  for  sharing 
lessons  learned  in  the  classroom  assessment 
process;  not  merelv  lessons  learned  from  read- 
ing the  book.  It  is  a time  to  share  successes,  to 
discuss  those  strategies  that  worked  and  whv.  It 


Mj'  recowwended  strategy  relies  even 

more  heavily  on  individual  study. 

also  is  a time  to  share  difficulties  team  mem- 
bers may  have  experienced,  to  figure  out  why 
problems  came  up,  and  to  find  solutions. 

Motivating  Participation  in  Learning 
Teams  - The  learning  team  method  of  profes- 
sional development  takes  advantage  of  four  fac- 
tors that  can  encourage  participation.  It  offers; 

1 . lndi\'idual  study  for  participants  who  have 
an  interest  in  experimenting  on  their  own 
(with  minimum  risk  of  embarrassment  if 
things  go  wrong); 

2.  Collaborative  study  for  those  who  like  to 
work  together  to  share  experiences  and 
lessons  learned; 

3.  Training  when  members  feel  it  is  an  apjjro- 
priate  part  of  their  overall  professional 
development  plan;  and 

4.  Time  to  concentrate  on  one  important  toj^ic 
long  enough  to  internalize  some  new  and 
useful  ideas. 

For  many  educators,  the  promise  of  these 
four  factors  will  be  incentive  enough  to 
encourage  their  participation.  But  for  those 
who  need  additional  incentive,  the  district 
might  provide  release  time  or  extended  con- 
tract time  to  permit  teachers  to  participate  in 
these  efforts.  Another  option  includes  estab- 
lishing an  ongoing  working  relationship  with  a 
higher  education  institution  to  offer  graduate 
credit.  It  has  been  our  experience  at  the  Assess- 
mentTraining  Institute  that  colleges  of  educa- 
tion arc  most  willing  to  enter  into  productive 
working  relationships  with  districts  to  make 
such  an  offering  possible. 

A Final  Thought 

( )nc  need  only  contcm]:)latc  the  dangers  to  stu- 
dents of  the  inaccurate  day-to-day  classroom 
assessment  of  their  achievement  to  understand 
how  critical  assessment  literacy  is  to  the  effec- 
tive functioning  of  schools.  If  we  mismeasure 
achievement,  we  might  fail  to  identify  impor- 
tant learner  needs,  group  students  inappi  opri- 
atclv,  place  faith  in  instructional  strategics  that 
rcallv  don’t  work,  assign  inaccurate  grades. 


leave  students  with  a sense  of  failure  when  they 
really  succeeded,  or  leave  students  feeling  suc- 
cessful when  they  really  failed.  In  short,  we 
place  students  directly  in  harm’s  way.  Yet,  even 
in  the  year  2000,  we  cannot  assure  our  stu- 
dents and  their  families  that  we  accurately 
assess  achievement. 

We  have  yet  to  invest  the  assessment 
resources  needed  to  build  an  assessment 
literate  school  culture.  We  know  what  teachers 
need  to  know  to  function  effectively  as  class- 
room assessors,  and  we  know  how  to  helj) 
them  become  assessment  literate.  We  have  very 
flexible  and  efficient  professional  development 
options  available  to  us. Teachers  just  need  the 
opportunity  to  team  u|)  and  learn.  O 

Note 

This  article  has  been  excerpted  from  “Learning 
Teams  for  Assessment  Literacy”  published  by 
the  Assessment  Training  Institute  in  Portland, 
Oregon.  Direct  inquiries  to  the  Assessment 
Training  Institute:  50  .SW  2nd  Ave.,  .Suite  300, 
Portland,  Oregon  97204,  LI. S.  1 (800)480-3060 
or  ati(^assessmentinst.com 
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Section  1 


Assessment  Literacy 


Steven  Katz  and  Lorna  Earl 

The  Paradox  of 
Classroom  Assessment 


“Marks  really  Jo  not  jit  ivitb  the  thrust  oj  the  cur- 
riculum we  are  using." 

“How  do  you  know  that  a kij  ‘appreciates’?  That  is 
really,  really  tough  to  measure." 

“The  interim  report  asks  for  satisfactory  or  not  satis- 
factory. Well,  what  is  satifactory?Who  defines  what  is 
satisfactory?  Is  it  50s,  60s,  70s?  It’s  not  really  clear. 
And  if  it's  not  clear  to  us  it’s  not  clear  for  the  parents" 

“I  modified  the  program  so  they  can  he  successful. 
Well,  what  is  successful?  Is  successful  50%,  60%, 
S0%o?  When  you  modify  for  those  children  so  that 
they  are  successful,  ijyou  have  a watered  down  pro- 
gram to  the  extent  that  these  children  are,  on  paper,  a 
success,  and  they  go  off  to  high  school  and  those  mod- 
ifications aren't  met, you’ve  watered  it  down  to  the 
extent  that  it’s  not  a true  outcome." 

(from  Earl  & Katz,  in  press) 


W[  hile  assessment  of  students  in  terms 
of  expressed  goals  has  always  been  a 
central  feature  of  schooling,  recent 
concern  with  accountability  has  led 
to  an  increased  focus  on  programs  that  assess 
students  against  “objective”  standards. The  out- 
comes of  such  assessment  programs  can  then 
be  used  to  judge  not  only  children  relative  to 
each  other,  but  also  classrooms,  schools, 
provinces,  and  nations. Teachers,  understand- 
ably, are  poised  halfway  between  the  children 
they  serve  and  the  mandated  “objective”  stan- 
dards. Their  conflict  is  apparent  in  the  com- 
ments above — comments  from  real  teachers 
grappling  with  changes  in  classroom  assess- 
ment. In  this  article,  we  identify  the  roots  of 
the  conflict. 

Schools  are  the  institutions  charged  with  the 
transmission  of  competencies  from  generation 
to  generation.  Teachers,  however,  are  caught 
between  two  sets  of  responsibilities  in  their 


classes.  They  are  required  to  ensure  that  stu- 
dents meet  fixed  and  predetermined  goals,  yet 
they  are  very  aware  that  their  students  are  indi- 
viduals with  varied  backgrounds,  interests,  and 
understandings  (Clay,  1996;  Olson  & Katz,  in 
press).  Contradictions  inherent  in  classroom 
assessment  practices  become  unavoidable 
because  each  of  these  elements  map  onto  a dif- 
ferent conception  of  competence. 

There  are,  at  least,  two  very  different  con- 
ceptions of  competence  at  play  on  the  land- 
scape of  formal  education  (Katz,  in  press). 
What  are  these  two  contrasting  notions  of 
competence?  What  are  their  implications  for 
assessment?  In  answering  these  questions,  we 
expose  the  paradox  of  classroom  assessment. 


There  are,  at  least,  two  very 
dijjerent  conceptions  oJ competence 
at  play  on  the  landscape  of 
f)rmal  education. 


“The  Known” 

“Now,  what  I want  is  Facts.  Teach  these  boys 
and  girls  nothing  but  Facts.  Facts  alone  are 
wanted  in  life.  Plant  nothing  else,  and  root  out 
everything  else. You  can  only  form  the  minds  of 
reasoning  animals  upon  Facts;  nothing  else  will 
ever  be  of  any  service  to  them. . .” 

So  went  the  opening  rant  of  Dickens’  charac- 
ter, Mr.  Thomas  Gratigrind,  as  he  presented 
himself  to  “..  .the  little  pitchers  before  him, 
who  were  to  be  filled  so  full  of  facts.”  Although, 
these  days,  no  one  urges  just  the  facts,  compe- 
tence defined  in  terms  of  the  possession  of 
knowledge  is  a well-established  feature  of 
schooling.  Students  arrive  at  school  with  minds 
considered  devoid  of  the  necessary  facts,  rules. 


and  principles  which  must  then  be  transferred 
in  a unidirectional  fashion  from  the  instructor, 
text,  or  other  authority. Teaching  becomes  an 
exercise  in  telling,  and  learning  an  exercise  in 
remembering  (Olson  & Katz,  in  press). 

The  substance  of  what  is  told  (taught)  and 
what  is  remembered  comes  in  the  form  of 
propositional  knowledge,  knowledge  that  is 
taken  to  have  an  existence  independent  of  the 
individual  knower.  The  general  assumption  is 
that  knowledge  is  found  not  made,  that  truth  is 
“the  truth,”  not  that  which  is  taken  to  be  true. 
Few  people  ever  doubt  this  traditional  view  of 
“the  known.”  For  most,  knowledge  is  certain 
and  permanent,  and  viewed  as  either  right  or 
wrong.  Chandler,  Boyes,  and  Ball  (1990,  p. 
377)  caricaturize  this  “absolutist”  statement  of 
knowledge  as  a “free-standing  attribute  of  the 
environing  world  that  only  secondarily  comes 
into  the  passive  possession  of  those  who, 
because  they  happen  to  be  in  the  right  place  at 
the  right  time,  automatically  end  up  with  some 
portion  of  the  unmitigated  truth  directly 
embossed  upon  the  recording  equipment  of 
their  minds.”  Disagreements  between  people, 
then,  can  be  attributed  to  the  lack  of  facts 
among  one  of  the  parties,  or  the  reins  of  cer- 
tainty are  pulled  in  by  reference  to  a disagree- 
able position  as  “just  your  opinion.” 

In  this  view,  appropriate  authorities  authen- 
ticate “the  truth.”  Belenky  et  al.  ( 1 986)  call  this 
“silent  knowing,”  in  which  the  individual 
accepts  the  authority’s  proclamation  about 
what  is  true.  There  is  no  belief  that  the  knower 
can  learn  from  his  or  her  own  experiences  and 
knowing  does  not  belong  to  the  individual. 
This  external  definition  of  “the  known”  pro- 
vides clear  specifications  as  to  what  is  to  be 
taught.  Nowhere  is  this  manifestation  more 
evident  than  in  formal  curriculum  documents 
that  embody  those  truths. 

What  is  especially  interesting  from  our 
assessment-centred  perspective  is  that  in  pro- 
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viding  such  clear  specifications  of  “the  known” 
as  that  which  must  lie  taught,  the  formal  cur- 
riculum also  provides  an  associated  set  of  stan- 
dards for  assessing  learning  achievements. 
Classroom  assessment  becomes  the  vehicle  for 
gauging  the  closeness  of  fit  between  what  is 
told  and  what  is  remembered  (Earl  & Katz,  in 
press). The  evidence  used  to  justify  beliefs  as 
“knowledge”  is  traceable  to  authorities  (e.g. , 
books,  teachers,  media).  Since  “the  truth”  is 
acquired  from  appropriate  authorities,  justifi- 
cation for  belief  normally  takes  the  form  of 
what  Belenky  et  al.  (1986)  have  termed 
“received  knowing.”  That  is,  evidence  consists 
of  congruitv  \\  ith  the  authority,  be  it  person 
or  text. 

Assessments  of  all  kind.s — from  questioning 
in  class  to  formal  examinations — operate  to 
|5crform  this  “concordance  check.”  A common 
classroom  pattern  is  the  IRE  sequence  (Initiate, 
Respond,  and  Evaluate),  where  the  teacher 
asks  a question,  a student  responds,  and  the 
teacher  gives  feedback  (Alvermann,  O’Brein, 
& Efillon,  1990;  Cazden,  1988).  Unlike  ques- 
tions which  arc  genuine  requests  for  informa- 
tion, in  classroom  questioning  teachers  are 
aware  of  the  answers  they  are  looking  for 
(Applebec,  1996). Thus,  Gradgrind’s  request 
for  his  star,  ‘bvell-crammed”  pupil,  Bitzer,  to 
define  a horse  has  nothing  to  do  with  Grand- 
grind’s  knowledge  or  interest  in  the  equine 
domaiTi  and  everything  to  do  with  gauging  the 
congruitv  ol  Bit/.er’s  definition  of  a horse  with 
that  given  by  the  dictionary  as: 

“Quadru|ied.  Graminivorous.  Eorty  teeth, 
namelv,  twentv-lour  grinders,  four  eve-teeth, 
and  twelve  incisive.  Sheds  coat  in  the  spring;  in 
marshv  countries,  sheds  hoofs,  too.  tloofs 
hard,  but  requiring  to  be  shod  with  iron.  .Age 
know  n bv  marks  in  mouth.  ” 


The  point  is  further  illustrated  by  the  experi- 
ences of  those  wdio  have  worked  with  younger 
children  and  received  one  of  the  follow'ing 
answ'crs  to  a less  than  honest  “why”  question: 
“Because  you  said  so”  or  “Because  the  book  said 
so.” 

By  defining  that  which  is“know'n”and  subse- 
quently what  must  be  taught,  the  formal  cur- 
riculum is  essentially  selective  (Glaser  & 
Silver,  1994).  We  have,  as  just  one  illustration, 
the  provincial  government  of  Ontario  intro- 
ducing a highly  centralized,  domain-specific 
provincial  curriculum  which  spells  out  exactly 
what  students  will  know'  and  when.  Eor  exam- 
ple, in  mathematics,  by  the  end  of  Grade  8 stu- 
dents w'ill  “re[5resent  whole  numbers  in 
ex|5anded  form  using  powers  and  scientific 
notation  (e.g.,  347  = 3xl02  + 4xl0  + 7;356 

3.S6x  10^)”  (Ontario  Ministry  of  Education 
and  Training,  1997,  p.  26).  The  surrounding 
rhetoric  explains  the  ease  with  w’hich  children 
wall  be  able  to  move  between  school  board 
jurisdictions,  given  the  new-found  consistency 
in  what  is  to  be  taught  and  learned. 

The  virtue  of  such  a specif  ic  curriculum  is  its 
direct  relationship  to  w'hat  must  be  taught. This 
specification  sets  the  stage  for  a rather  specific 
definition  of  accountability,  accountability 
defined  as  a kind  of  surveillance  mechanism 
which  proceeds  by  W'ay  of  a congruity  check. 
What  is  prescribed  by  the  formal  curriculum 
necessarily  exists  apart  from  individual  teach- 
ers and  their  students.  It  is  a blueprint  for  com- 
mon action  and  by  definition  a yardstick  for 
common  evaluation,  hence  systemic  account- 
ability. In  this  way,  it  is  possible  to  begin  to  talk 
about  a target  competence  “norm”  or  “bench- 
mark .” 

Assessment,  in  this  sense,  is  about  judg- 
ment, judgment  about  who  w'ill  go  on  and 
where  they  will  go,  or,  to  put  it  differently, 
about  who  is  competent  and  who  is  not. 

While  today’s  classrooms  exemplify  the 
educational  \ ision  detailed  above,  they  are  also 
characterized  by  more  than  simjily  a concern 
for“thc  known.”  In  this  conception,  personal 
beliefs,  indeed,  personal  interests  and  back- 
grounds arc  relegated  to  the  substandard  posi- 
tions of  speculation  and  opinion. 

“The  Knower” 

In  contrast  to  Bitzer’s  definitional  exactitude, 
young  Sissy  jupe  includes  her  experiences  with 


the  animal  in  her  definition  of  a horse. This  def- 
inition meets  with  the  Gradgrind  reply,  “Girl 
number  twenty  unable  to  define  a horse!  Girl 
number  tw'enty  possessed  of  no  facts,  in  refer- 
ence to  one  of  the  commonest  of  animals!” 
I low'evcr,  much  of  wdiat  w'e  see  in  today’s  class- 
rooms accepts,  indeed  encourages,  what  is 
known  subjectively  and  experientially  and 
seeks  to  develop  it.  This  image  of  respect  for 
the  child’s  point  of  view  is  one  well  captured  in 
the  writings  of  John  Dewey.  In  nature,  he 
argued,  thinking  is  stimulated  by  real  problems 
that  the  learner  has  a personal  vested  interest 
in  solving  (Dewey,  1 902/  1 966). 

Child-centredncss  is,  by  now,  a dominant 
theme  in  both  cognitive-developmental  and 
sociocultural  perspectives  of  education.  Learn- 
ing is  seen  to  occur  as  previously  acquired  cog- 
nitive structures  are  coordinated  to  form  new 
superordinate  structures.  Initially,  structures 
develop  from  concrete  experiences,  and  think- 
ing remains  concrete  until  the  coordination  of 
structures  allows  for  the  emergence  of  abstract 
thought.  Cognitive  development  is  regarded  as 
a socially  mediated  jjrocess.The  conversation 
metaphor  (Applebee,  1996)  is  a popular  one, 
with  participation  in  classroom  discourse  serv- 
ing as  the  vehicle  through  which  meanings  are 
constructed. 

In  considering  the  child’s  point  of  view,  the 
mind  is  acknowledged  as  a place  of  privately 
held  beliefs  and  ideas  (Olson  & Bruner,  1 996; 
Olson  & Katz,  in  press).  Children  are  seen  as 
individuals  capable  of  making  sense  of  their 
world  both  through  their  interactions  with  the 
environment  and  with  others.  Learning,  then, 
is  a process  of  subjective  interpretation,  while 
teaching  creates  opportunities  for  sharing 
beliefs  through  collaborative  discourse. 

Defining  competence  in  terms  of  “the 
knower”  leads  to  a very  dif  f erent  set  of  assump- 
tions than  those  discussed  in  connection  with 
“the  known.”  In  recognizing  that  “the  known”  is 
neither  God-given  nor  an  indisputable  fact  of 
nature,  knowledge  is  viewed  as  fundamentally 
made,  not  found,  and  consequently  uncertain. 
Truth  is  seen  as  varying  from  person  to  person 
and  knowledge  is  interpreted  subjectively. 
Belenkv  et  al.  ( 1 986)  use  the  term  “subjective 
knowing.”  Personal  beliefs  count  as  evidence 
for  knowing. To  justifv  beliefs  is  to  share  them 
with  others.  Competence  is  seen  as  drawing 
ideas  together  in  a wav  that  makes  sense. 
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This  notion  of  competence  prov  ides  a new' 
perspective  on  classroom  assessment.  Learn- 
ers, as  interpreters,  necessarily  construct 
somewhat  different  interpretations  of  any  text 
or  event.  Classroom  assessment  in  this  view  is 
the  mechanism  that  promotes  the  interpreta- 
tion and  revision  processes  of  the  learner.  It  is 
something  best  accomplished  by  the  self  since 
it  is  the  knower  who  holds  privileged  access  to 
the  relevant  beliefs  and  intentions,  though  they 
are  also  obliged  to  give  a public  account. This 
accounts  for  the  interest  in  portfolios  and 
other  self-assessment  vehicles  (Earl  & Cousins, 
1 996;  Wilson,  1996)  which  promote  students’ 
articulation  of  their  own  reasons  for  their 
beliefs  and  opinions  rather  than  right  answers 
as  dictated  by  an  authority  (Buchmann,  1 986). 

When  reasons  replace  right  answers,  assess- 
ment, as  we  have  seen,  becomes  in  large  part 
the  responsibility  of  the  know'er;  the  knower 
has  to  justify  his  or  her  view's.  Assessment 
opportunities  in  classroom  patterns  can 
change  too,  from  IRE  to  ICE  (Ideas,  Connec- 
tions, Extensions).  ICE  encourages  students  to 
form  and  share  their  own  ideas,  connect  them 
to  one  another,  and  extend  them  beyond 
personal  experience  (Wilson,  1996).  Gardner 
( 1 990)  has  proposed  “individually  configured 
excellence”  as  a title  rellective  of  this  adaptive 
model  of  education.  Schooling  w'orks  to 
identify  and  develop  sources  of  competence 
in  individual  students.  It  takes  individual 
backgrounds,  interests,  and  understandings 
into  account. 

Conceptions  of  education  driven  by  a con- 
cern for  “the  know'er”  have  their  own  limita- 
tions. When  competence  is  seen  as  purely 
subjective,  truth  becomes  variant  and  certain- 
ty is  elusive.  As  Chandler  and  colleagues 
(1990,  p.  379)  comment,"...  all  claims  are 
challenged,  every  heart  felt  belief  is  hchl  up  to 
ridicule,  and  all  action  is  seen  as  permanently 
premature.” The  problem  here  is  that  in  the 
absence  of  certainty,  all  beliefs  appear  equal.  It 
is  this  very  phenomenon  that  supports  medi- 
ocrity or,  as  Neatby  (1953)  puts  it,  a system  of 
education  that  offers  “so  little  for  the  mind.” 
Without  objective  standards,  and  the  associat- 
ed norms  or  benchmarks,  systemic  account- 
ability becomes  jrroblematic  for  both 
individuals  and  educational  institutions.  It  is  in 
terms  of  such  standards  that  schools  are  held 
accountable  for  fulfilling  an  institutional  man- 


date, a mandate  generally  advanced  in  terms  of 
those  very  standards. 

The  Paradox  Exposed 

Educational  theory  for  much  of  the  last  century 
attempted  to  come  to  grips  with  this  gap 
betw'een  what  is  known  generally  and  should  be 
transmitted,  and  what  is  known  subjectively  and 
should  be  developed.  Yet  this  effort  typically 
consisted  of  little  more  than  staking  opposing 
claims  on  the  epistemological  battleground. 
Classical  education  theory  considered  know- 
ledge to  be  an  entity  that  exists  in  some  tangible 
form  capable  of  being  transferred  intact  to 
children.  Educational  reformers,  such  as  Dew'ey, 
took  the  other  pole  insisting  on  the  primacy  of 
subjective  and  communal  experience  as  the 
basis  of  all  knowledge. 

Although  theorists  have  been  more  or  less 
content  to  operate  in  spheres  defined  by  one 
epistemology  or  the  other,  teachers  do  not 
enjoy  the  luxury  of  the  separation.  Both  ele- 
ments are  necessary  in  communicating  some- 
thing about  the  learner  to  the  learner  and  to 
others.  They  each  provide  a way  of  thinking 
about  the  sell  and  serve  as  vehicles  through 
which  children  come  to  think  of  themselves  as 
competent  on  the  one  hand  or  incompetent  on 
the  other.  The  challenge  to  educational 
researchers  and  practitioners  is  very  simply — 
how  to  reconcile  them?  Q 
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Two  Solitudes — 

Classroom  Teachers  and 
Psychometric  Researchers 


Tl  he  assumption  that  teachers  need  to 
improve  their  knowledge  of  psychometric 
practice  is  often  embedded  in  evaluation 
policies  and  in  research  conducted  by 
measurement  specialists.  But  most  researchers 
who  specialize  in  measurement  and  evaluation 
do  not  have  a very  good  basis  for  making  rec- 
ommendations about  classroom  assessment 
since  they  don’t  understand  what  teachers 
actually  do  and  need  in  the  context  of  their 
practice.  Unfortunately  they  have  a“decontex- 
tualized”  understanding  of  the  practice  of  stu- 
dent assessement  which  has  resulted  in  a case 
of  two  solitudes.  This  article  explores  the  gap 
in  understanding  betw'een  educators  and 
researchers  and  jrolicy  makers. 

Common  Research  Assumptions 

In  the  educational  literature  on  student  assess- 
ment, there  is  a tradition  of  jrroviding  teachers 
with  “best  practice”  as  defined  by  those  with 
an  expertise  in  measurement  and  evaluation 
(see  Mayo,  1964).  This  conceptual  model 
assumes  that  if  classroom  assessment  practice 
is  logically  derived  from  |5sychomctric  prac- 
tice, then  better  judgments  and  decisions  for 
students  w ill  result,  thereby  enhancing  stu- 
dent learning.  Indeed,  most  psychometric 
researchers  perceive  teachers  to  be  cffccti\  c 
in  conducting  student  assessments  when  they 
ai  t as  measurement  technicians.  Similarly, 
most  policy  documents  assume  that  these  tra- 
ditioTial  methods  of  assigning  grades  to  stu- 
dents an-  irreferable  means  of  student 
assessment  practice. 

Typical  of  literature  based  on  this  assumj:)- 
tion  is  a recent  study  bv  No\ak,  Herman,  & 
Gearhart  ( 1996)  w hich  imestigates  the  ade- 


cjuacy  of  a new  rubric  for  assessing  narrative 
w'riting.  Using  percentage  of  agreement,  cor- 
relations between  raters,  and  generalizability 
coefficients,  the  authors  report  support  for  the 
rubric  in  terms  of  reliability  of  use  across  mul- 
tiple samples  of  work.'fhe  study  ends  wdth  a 
recommendation  for  teacher  use. The  unstated 
assumptions  behind  these  prescriptions  are 
that  teachers  require  a high  degree  of  score 
accuracy  in  their  use  of  rubrics  and  that  the 
same  elements  w'ould  feature  in  assessments 
across  all  examples  of  student  assignments  in 
narrative  w'riting. 

In  a second  example,  Frisbie  & Friedman 
(1987)  define  the  domain  of  assessment  and 
evaluation  know  ledge  that  teachers  should 
possess.  They  derive  their  recommendations 
for  teachers  from  the  Test  Standards  docu- 
ment; a volume,  produced  by  test  and  mea- 
surement specialists  from  the  American 
Psychological  Association,  the  National  Coun- 
cil on  Measurement  in  Education,  and  the 
American  Educational  Research  Association. 
The  authors’  expectation  is  that  teachers  w'ill 
take  their  recommendations  and  use  them  to 
jjroduce  defensible  assessments  of  their  stu- 
dents. Support  for  the  suggested  criteria  is  a 
“decontextualized”  understanding  of  teachers’ 
practices  in  student  assessment.  And,  the 
assumption  is  that  these  principles,  once  in 
place,  will  result  in  better  learning  for  all  stu- 
dents. 

In  a paper  summarizing  trends  in  perfor- 
mance assessment,  Arter  and  Stiggins  ( 1 992) 
oiler  some  “lessons  learned  to  date  in  perfor- 
mance assessment.”  They  begin  with  the  need 
lor  clear  targets  and  then  move  on  to  the  tech- 
nical demands  of  comparability  and  accuracy. 


Most  researchers  who  specialize  in 
measurement  and  evaluation 


do  not  have  a very  good 
basisjor  making  recommendations 
about  classroom  assessment 


They  also  conclude  with  some  recommenda- 
tions for  teachers;  namely  that  “to  have  perlor- 
mance  assessments  that  mean  anything,  we 
need  to  first  ensure  that  teachers  perceive  them 
as  good  instructional  tools  and  know'  how'  to 
use  them  as  instructional  tools”  (p.  8).  Arter 
and  Stiggins  argue  that  this  appropriate  use  will 
require  a great  deal  of  teacher  training.  Yet, 
these  researchers  provide  no  evidence  that  sup- 
ports the  notion  that  beginning  with  “clear  tar- 
gets” would  be  more  desirable  for  teachers, 
than,  say,  knowledge  of  the  learner.  Nor  is  there 
any  defense  for  the  notion  that  teachers’  first 
concerns  should  be  with  the  assessments  as 
instructional  tools  rather  than  with  instruction- 
al tools  that  might  serve  as  assessments. 

Stiggins  ( 1 988)  also  assumes  that  psychome- 
tric knowledge  is  related  to  “best  practice.”  Fie 
asserts  that  “the  grading  practices  of  many 
teachers  are  deeply  flawed. . .teachers  are 
often  untrained  in  -and  therefore  are  often 
unaware  of  the  principles  of  sound  grading” 
(p.  365).  In  accordance  with  this  belief,  he  rec- 
ommends a program  of  teacher  education  that 
emphasizes  training  and  technical  assistance 
pro^  ided  by  classroom  assessment  specialists 


Section  1 (P'  ^ 

^11 


a 

Assessment  Literacy 


. . . there  is  a tradition  of  providing 
teachers  with“best  practice’as  defined 
by  those  with  an  expertise  in 
measurement  and  evaluation 


who  also  provide  in-servicc  education.  He  fur- 
ther recommends  that  training  and  certifica- 
tion involve  teachers  in  learning  about:  many 
purposes  and  methods  of  assessment,  rele- 
vance for  their  grade  and  subject,  congruence 
with  their  district  policies,  and  key  features  of 
oral  and  nonverbal  feedback.  While  simultane- 
ously advocating  the  need  for  more  research  in 
classroom  assessment,  it  appears  that  Stiggins’ 
recommendations  can  be  implemented  prior 
to  the  presentation  of  any  empirical  findings. 
As  noted  earlier,  this  approach  is  endemic  in 
the  field  of  classroom  assessment  research  and 
in  the  evaluation  policy  decisions  made  in 
schools. 

When  an  empirical  investigation  of  teach- 
ers’ practices  is  conducted,  researchers  also 
frec|Licntly  use  “best  practice”  as  the  criterion 
against  which  teachers  are  rated.  However, 
they  commonlv  assume  that  “best  practice” 
relates  to  the  use  of  psychometric  knowledge 
in  classroom  assessment  rather  than  to  the  use 
ot  an  understanding  of  the  context  of  student 
assessment  as  it  occurs  in  the  classroom. 

For  example,  Oeschcr  and  Kirby  (1990) 
conducted  a study  intended  to  “develop  and 
apply  a model  that  can  he  used  in  identifying 
classroom  teachers’  assessment  needs”  (p.  1 ). 
The  study  cited  literature  which  suggested  that 
teachers  do  not  engage  in  systematic  analyses 
of  their  tests,  and  thus  do  not  know  what  kinds 


of  learning,  if  any,  their  tests  are  measuring. 
Oescher  and  Kirby  ( 1 990)  collected  the  most 
recently  administered  test  from  35  mathemat- 
ics and  science  teachers.  These  tests  were  then 
analyzed  according  to  item  format,  cognitive 
levels  addressed,  item  quality,  and  presenta- 
tion, as  the  researchers  held  these  factors  to  be 
important  for  reliability  and  validity.  Not  sur- 
prisingly, the  authors  found  inadequacies  in 
their  teachers’  instruments  using  these  crite- 
ria. They  noted  that,  “teachers  do  not  consis- 
tently use  tables  of  specifications  to  construct 
their  tests,  nor  do  they  empirically  analyze 
item  or  test  level  data”(p.  14). 

From  the  assumptions  made  by  measure- 
ment specialists  in  their  recommendations  for 
teachers  and  in  their  empirical  research,  it  is 
evident  that  most  researchers  have  considered 
test  design  and  the  analysis  of  test  results  to  be 
more  important  than  the  context  in  which  stu- 
dent assessment  is  being  implemented  in  the 
classroom.  Unfortunately,  these  traditional 
beliefs  and  assumptions  have  been  transferred 
into  the  policy  decisions  made  in  schools. 
Thus,  policy  documents  that  encourage  teach- 
ers to  place  an  emphasis  on  quantitative  prac- 
tices might  be  encouraging  teachers  to 
decontextualize  their  understanding  of  stu- 
dents in  their  assessment  practices. 

In  Classroom  Contexts 

There  are  some  examples  of  research  in  which 
psychometric  assumptions  have  been  kept  to  a 
minimum.  In  such  literature,  more  of  the 
teachers’  own  values  have  emerged.  In  a few 
instances,  action  research  has  been  conducted 
by  teachers  themselves.  Saurino  & Saurino 
( 1 994),  for  example,  report  on  research  they 
conducted  on  the  use  of  alternative  assess- 
ments in  their  Grade  8 classroom.  In  compari- 
son to  research  conducted  by  measurement 
specialists,  their  results  are  unrelated  to  the 
accuracy  and  adequacy  of  the  instruments 
implemented  during  the  research.  Instead, 
Saurino  and  Saurino  found  that  the  use  of  alter- 
native assessments  improved  motivation  and 
academic  achievement  among  four  out  of  live 
at-risk  students  studied,  while  teacher-student 
relationships  also  benefited.  If  school  policies 
had  inhibited  these  teachers  from  im[)lement- 
ing  alternative  assessment  practices  in  their 
classrooms,  then  these  important  findings 
might  never  have  been  made. 
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When  researchers  go  into  classrooms  with- 
out advance  criteria,  they  frequently  find 
that  teachers  do  have  different  purposes  for 
assessments;  goals  that  seem  more  salient  to 
their  practices  than  to  technical  adequacy. 
For  example,  Philipp,  Flores,  Sowder,  & 
Schappelle  (1994)  examined  the  practices  of 
four  exemplary,  middle  school  mathematics 
teachers  and  found: 

1 .The  teachers  were  comfortable  about  their 
means  of  assessment  and  saw  it  as  critical  to 
their  teaching. 

2 . They  used  writing  as  an  essential  component 
of  mathematics  assessment,  requiring  that 
their  students  maintain  a mathematics  journal. 

3.  They  used  the  “quality  of  student  explana- 
tions” as  a tool  for  assessment. 

4.  Observation  of  students’  activities  during 
class  was  another  important  tool  for  assess- 
ment. 

Clearly,  any  attempt  to  survey  these  teach- 
ers’ practices  with  questionnaires  designed  to 
assess  their  congruence  with  formal  testing 
practices  would  miss  much  of  what  they  do. 

Nicholson  & Anderson  (1993)  move  closer  to 
discovering  modes  of  assessment  that  teachers 
use  in  practice. Through  interviewing  21  teach- 
ers from  Kindergarten  to  Grade  4,  they  found 
that  teachers  believe  that  assessment  serves  sev- 
eral purposes  and  is  not  merely  an  Indicator  of 
achievement.  Most  importantly,  the  teachers 
believe  that  their  assessment  methods  help  them 
to  determine  what  their  students  need  to  learn. 
Reporting  to  parents  is  the  next  most  important 
purpose,  but  assessment  also  serves  the  goal  of 
determining  students’  learning  styles,  ensuring 
teacher  accountability,  and  providing  a record 
for  future  teachers. To  accommodate  this  variety 
of  needs,  these  teachers  relied  most  often  on 
constant  observation  of  their  students.  In  addi- 
tion, these  teachers  were  seemingly  uncon- 
cerned about  the  accuracy  and  validity  of  their 
observations  although  they  did  worry  about 
missing  the  quiet  students. 

Implications 

There  is  a sense  of  two  solitudes  in  the  litera- 
ture concerning  classroom  assessment  prac- 
tice. On  the  one  hand,  there  is  a large  body  of 
published,  academic  literature  that  features  lit- 
tle empirical  study  of  practice  in  schools  and  a 
lot  of  expert  recommendations  for  teachers  to 
follow.This  literature  has  traditionally  been  the 


When  researchers  go  into  classrooms 
without  advance  criteria, 
thej  freqiientlyjind  that  teachers 
do  have  dijferent  purposes 
for  assessments. . . 

reference  point  for  creating  school  evaluation 
policy.  (3n  the  other  hand,  there  is  a body  of  lit- 
erature featuring  teachers’  personal  ex|)eri- 
cnccs  with  techniques  of  assessment  that  meet 
their  perceived  instructional  needs.  As  each 
grou]5  has  a different  set  of  criteria  for  what 
c(3nstitutes  best  practice,  and  which  purposes 
of  assessment  are  more  critical,  there  is  little 
overlap  between  the  two  literatures. 

If  we  seek  to  change  practice  in  ways  that 
enhance  the  role  of  assessment  in  classrooms 
and  schools,  there  is  a need  to  first  determine 
the  roles  that  assessment  is  supposed  to  play  in 
these  settings.  It  will  he  important,  then,  to 
determine  how  school  policies  intluence 
teachers’  practice  and  to  seek  ways  of  making 
policy  changes  that  are  relevant  to  how  assess- 


ment is  conducted  in  the  context  of  classrooms 
and  schools.  Such  changes  might  encourage 
teachers  to  continue  to  improve  their  practices 
rather  than  hinder  them  in  doing  so.  O 
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The  New  World  of 

Performance-based 

Assessment 


Assessment-led  reform  plays  an  integral 
jtart  in  promoting  higher  standards  of 
teaching,  learning  and  public  account- 
i ability  (Earl,  1 995).  According  to  Stig- 
gins  (1990),  classroom  assessment,  in 
particular,  influences  student  learning,  student 
self-concept  and  general  pedagogy.  Although 
large-scale  assessments  generally  receive  the 
most  public  attention,  classroom  assessments 
(which  include  performance-based  assess- 
ment) are  becoming  increasingly  important. 

Classroom  assessment  has  traditionally  con- 
sisted of  teacher-designed  paper  and  pencil 
tests  interjected  at  the  end  of  a unit  of  study  to 
ascertain  the  extent  of  student  learning  leading 
to  a grade. This  type  of  assessment  often  focuses 
on  memorization  and  basic  skill  development 
(Stiggins,  1997).  As  educational  reform  gains 
wider  public  acceptance,  there  has  been  a call 
for  increased  use  of  assessment  approaches  that 
go  beyond  the  traditional  paper  and  pencil  for- 
mat to  include  strategies  like  performance 
assessment  (Stiggins,  1997). These  alternative 
assessment  approaches  reflect  a shift  in  empha- 
sis from  assessment  as  a selection  procedure  to 
one  of  certification,  accountability  and  learn- 
ing. Alternative  assessments  are  often  designed 
to  motivate  students  to  take  more  responsibili- 
ty tor  their  own  learning,  to  make  assessment 
an  integral  part  of  the  learning  experience  itself 
and  to  embed  the  process  in  authentic  learning 
activities  based  on  higher  order  thinking  skills 
(e.g. , investigation,  problem-solving,  persua- 
sive writing  etc.). 

The  underlying  principle  of  performance- 
based  assessment,  in  particular,  involves  assess- 
ing students  within  the  context  of  classroom 
tasks.  These  tasks  are  generally  accompanied 
by  a set  of  criteria  and  objectives  that  become 


the  basis  for  assessment.  Assessments  can 
include  pencil-and-paper  assessments,  self  and 
peer  assessments  and  conferencing,  in  which  a 
range  of  skills  and  knowledge  are  assessed 
(e.g.,  speaking  and  listening;  presentation  and 
organization  skills;  participation  and  leader- 
ship skills).  A key  component,  therefore,  of 
performance-based  assessments  is  its  “real- 
world”  or  practical  orientation.  Concrete, 
real-world  problems,  however,  are  messy, 
involve  uncertainty,  complexity  and  present 
measurement  difficulties.  As  a result,  “real- 
world  problems  often  do  not  harmonize  [well] 
with  mandated  curricula,  textbooks,  standard- 
ized tests... and  the  40  [or  80[  minute  period. 
[Not  surprisingly,]  teachers  who  attempt  using 
real-world  problems  with  their  students  tend 
to  be  those  renegades  who  thrive  on  change 
and  risk-taking”  (McDonald,  1991 : 21 ). 

This  article  is  about  the  experiences  ot  teach- 
ers and  students  who  participated  in  the  pilot 
stage  of  a performance-based  assessment  project. 

The  Millennium  Project 

The  Millennium  Project  was  designetl  as  a 
working  example  of  performance-based 
assessment,  developed  by  the  Assessment 
Training  Consortium,  a network  of  five 
Ontario  school  boards.  The  project  is  being 
phased  in  gradually  over  a period  of  several 
years,  and  this  particular  phase  was  designated 
as  the  project’s  [jilot  stage.  As  a first  phase 
implementation  of  this  project,  a few  schools 
from  each  board  were  selected  to  participate. 
A project  committee  consisting  of  representa- 
tives from  each  board  was  established. These 
|troject  team  members  managed  the  project 
with  the  assistance  of  a committee  of  teachers 
from  each  board. 
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...teachers  who  attempt  using 
real-world  problems  with  their 
students  tend  to  be  those  renegades  who 
thrive  on  change  and  risk-taking. 


The  Millennium  Project  can  be  seen  as  a 
vital  link  in  the  secondary  reform  initiative 
currently  underway  in  Ontario.  It  serves  as  a 
vehicle  for  implementing  progressive,  stan- 
dards-based  performance  assessment  at  the 
secondary  level.  While  the  assessment  was 
intended  to  generate  data  for  teachers  about 
their  students’  progress,  there  was  also  the 
potential  to  broaden  and  improve  secondary 
teachers’  classroom  assessment  practices.  Stu- 
dents involved  in  the  Millennium  Project 
(mostly  Grade  1 1 students)  were  required  to 
demonstrate  sophisticated  problem-solving 
and  critical  thinking  skills  throughout  the 
course  of  the  project.  Student  teams  were  each 
required  to  investigate  and  propose  a solution 


to  a complex,  real-life  problem. They  demon- 
strated evidence  of  their  abilities  to  think  criti- 
cally, to  conduct  research,  to  synthesize 
information  and  to  present  a solution  to  the 
problem,  both  orally  and  in  written  form,  and 
t(3  demonstrate  that  they  had  acquired  essential 
skills  and  knowledge  from  across  the  sec- 
ondary school  curriculum. 

The  problems  they  investigated  were  designed 
by  teams  ol  educators  from  each  of  the  member 
boards  and  were  intended  to  be  relevant,  rigor- 
ous, and  eclectic,  but  still  remain  curriculum 
based. The  students  were  expected  to  demon- 
strate the  process  of  their  investigation  in  addi- 
tion to  the  conclusions  they  reached.  The 
problems  were  carefully  constructed  in  a man- 
ner that  included  sufficient  information  to  sug- 
gest how  students  should  proceed  but  never 
enough  information  to  enable  students  to  solve 
the  problem  without  further  inquiry.  Students’ 
individual  and  group  work  as  well  as  their  oral 
defenses  were  evaluated  by  a variety  of  judges 
(including  community)  using  a number  of  dif- 
ferent rubrics  to  ensure  a fair  and  balanced 
assessment  procedure. 

Examples  of  student  jirojects  were: 

^ research  and  raise  awareness  about  the 
water  quality  of  the  Don  River 
^ design  a greenhouse  and  a new  science 
off  ice  with  storage  area  for  exemplars 
develop  a marketing  plan  for  school 
programs 

^ solve  a problem  in  biotechnology  and  deter- 
mine its  effect  on  medicine  or  industry 
research  the  pros  and  cons  of  a housing 
development  in  the  community 

A Pilot  Study 

fhc  jirimary  intent  of  our  study  was  to  deter- 
mine teachers’  and  students’  perceptions  of  a 
pertonnance-based  assessment  activity;  its 
benefits  and  pitfalls;  and  any  needed  modifica- 
tion, fhese  data  were  gathered  through  semi- 
structured  teacher  interviews,  student  focus 
groups  and  artifact  collection. 

Fourteen  schools  and  32  teachers  from  four 
school  boards  were  in\-ol\ed  in  the  pilot  pro- 
ject during  the  1 998/  1 999  school  year.  Four- 
teen teachers  and  48  students  from  Tiine 
schools  were  inteiwicwed.  The  schools  were 
primarily  selected  bv  project  team  members 


from  each  board.  An  attempt  was  made  to 
include  diverse  school  settings  and  subjects 
and  the  grade  levels  ranged  from  Grade  9 to 
OAC  (although  the  main  focus  of  the  project 
was  intended  for  Grade  1 1 ). There  were  some 
incidences  in  which  teachers  and  their  students 
requested  to  be  interview'ed.  Since  the  project 
was  implemented  in  the  final  semester,  the 
interviews  were  conducted  during  the  months 
of  May  and  June  1999.  Interviews  were  tape 
recorded  and  subsequently  transcribed.  One 
school  board  carried  out  the  pilot  project  in 
the  fall  of  1 999  and  was  not  part  of  the  current 
data  gathering  procedures. 

Findings 

A New  World  of  Assessment — Performance- 
based  assessment  is,  as  some  of  these  teachers 
discovered,  a new  world.  The  participating 
teachers  w^ere  involved  in  a dynamic  of  change 
that  influenced  their  conceptions  of  teaching 
and  assessment,  student  learning  and  their 
own  role  as  teachers  in  and  out  of  the  class- 
room. These  changes  are  characteristic  of  what 
Fullan  refers  to  as  “significant  change” — 
involving  the  use  of  new  resources,  new  teach- 
ing approaches  and  the  alteration  of  beliefs. 
Fullan  (1991)  states  that  educational  change 
does  not  consist  of  a single  focus;  rather,  it  is 
multi-dimensional.  Consequently,  the  impact 
of  the  project  on  teachers’  practices  and  beliefs 
was  multi-dimensional,  comj^lex  and  varied. 

Teachers  confronted  j:)roblems  in  terms  of 
their  ability  to  accommodate  implementation 
of  the  |5roject.  For  example,  teachers  struggled 
to  overcome  a lack  of  technical  skills  (e.g., 
computer)  and  subject  knowledge.  Contem- 
poraneous w'ith  these  challenges  w-ere  many 
organizational  constraints  that  made  imple- 
menting the  project  more  difficult.  Key  issues 
concerning  project  logistics  indicated  jjroblem 
areas  involving  resources  and  support. Teach- 
ers expressed  a need  for  suitable  research  and 
presentation  facilities,  financial  and  board  sup- 
port and  better  access  to  resources  (e.g.,  com- 
puters, software). 

Teachers  struggled  to  become  more  proH- 
cient  at  assessment.  Hargreaves  et  al.  (1  997) 
noted  in  a study  of  Grade  7 and  8 teachers 
implementing  The  Common  Curriculum  that 
“teachers  routinely  told  [them]  that  assessment 
[was]  the  hardest  part  [of  that  |)rocess[”  (p.  46). 


How  do  I assess  student  work  using 
these  new  assessment  approaches? 
What  should  I assess? 


How  do  I use  rubrics? 


Similarly,  teachers  in  this  study  identified  many 
assessment  issues  that  they  w'ere  concerned 
about.  In  particular,  teachers  felt  challenged  by 
the  prospect  of  implementing  new  assessment 
strategies. 

Teachers  asked  the  following  questions: 
How  do  I assess  student  work  using  these  new 
assessment  approaches?  What  should  1 assess? 
How'  do  I use  rubrics?There  w'as  also  the  per- 
vasive concern  about  “covering”  the  curricu- 
lum. For  many  teachers,  real-life  problems, 
despite  their  potential,  seemed  incompatible 
with  classroom  realities.  This  contradiction 
was  never  more  prevalent  than  when  teachers 
attempted  to  reconcile  assessment  practice 
with  grading  requirements. 

The  emotions  of  those  involved  in  the  pro- 
ject were  diverse. Teachers  experienced  feel- 
ings of  discomfort,  uncertainty,  apprehension, 
anxiety  and  frustration. These  feelings  seemed 
to  confirm  that  the  Millennium  Project  w'as  a 
new'  phenomenon  in  addition  to  being  a daunt- 
ing step  forward  for  many  teachers. Teachers  in 
essence  w'ere  asked  to  make  profound  changes 
in  their  teaching  and  assessment  practices,  as 
well  as  in  their  pedagogical  beliefs. 

Building  a Culture  of  Inquiry  Perhaps  the 
most  jiowerful  aspects  of  this  project  were  the 
occurrences  of  teachers  making  changes  in 
their  practice  that  were  guided  by  changing 
beliefs.  For  example,  teachers  collaborated 
w ith  interested  stakeholders  inside  and  outside 
the  school  (e.g.,  other  colleagues,  the  public 
and  the  local  business  community). Teachers 
also  wrestled  with  the  challenges  of  standards 
and  soon  realized  that  they  would  have  to 
entrust  their  students  to  external  experts  in 
order  to  gain  a more  accurate  assessment  of 
standards.  Teachers  frec|ucntlv  asked  the  fol- 
lowing questions:  When  is  a particular  perlor- 
mance  good  enough  and  when  is  it  not?  What 
does  a “good”  performance  look  like?  Idow  can 
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a school  reliably  establish  a standard  tor  the 
varied  performances  of  so  many  students 
engaging  in  so  many  different  tasks? 

As  a result  of  the  above  conditions,  a culture 
ot  inquiry  began  to  emerge. Teachers,  the  com- 
munity and  students  began  to  engage  in  a dia- 
logue about  these  very  issues.  Students  were 
required  to  seek  external  information  beyond 
school  walls.  Teachers  had  to  be  willing  to 
trust  their  students’  knowledge  and  the  exper- 
tise of  community  mentors.  The  project  began 
fostering  a different  conception  of  teaching 
than  just  the  delivery-of-instruction . This 
alternative  metaphor  of  teaching  resulted  in 
the  teachers’  role  altering  significantly  from 
the  traditional  one.  Teachers  became  tutors, 
mentors,  coaches,  collaborators,  consultants, 
guides,  gatekeepers  and  even  students  them- 
selves, helping  their  students  understand  their 
own  thinking  and  guiding  them  as  they 
searched  for  new  information.  As  a result, 
students  became  better  problem  solvers 
because  they  developed  skills  such  as  reason- 
ing, collaboration  and  persistence. 

This  shift  in  the  conception  of  teaching  cre- 
ated discomfort  for  some  teachers  while  oth- 
ers revelled  in  this  new  paradigm.  Certain 
teachers  had  difficulty  determining  how  to 
teach  under  these  circumstances — how  to 
grant  independence  while  still  providing  safe 
boundaries;  how  to  guide  without  directing; 
how  to  distinguish  between  a collaborative 
intervention  and  a controlling  one. 

Stretching  Student  Thinking  The  Millen- 
nium Project  was  intended  to  “stretch”  or 
expand  student  thinking.  Students’  responses 
indicated  that  the  Millennium  Project  promot- 
e<l  higher  order  learning,  recognized  and  pro- 
moted a wide  range  of  skills  and  achievements, 
empowered  students,  encouraged  creativity 
and  communication  and  pointed  to  new  con- 
ceptions of  knowledge.  More  specifically,  stu- 
dents enjoyed  non-teachcr-directed  activities 
and  the  open-endedness  of  the  project.  Teach- 
ers’ observations  of  their  students  included 
comments  such  as  the  lollowing:  “It  just  goes 
to  show  how  much  they’re  seeking  non- 
teacher-dirccted  things  to  do;”  “They  really 
liked  the  open-endedness;” “They  thought  it 
was  really  great  that  they  were  able  to  work  on 
something  so  different.” 

By  being  task  oriented,  the  Millennium  Pro- 


Teachers  became  tutors 


mentors,  coaches,  collaborators, 
consultants,  guides,  gatekeepers  and 
even  students  themselves. 


ject  had  the  capacity  to  recognize  and  promote 
a wide  range  of  skills  and  achievements, 
including  personal,  practical  or  intellectual 
ones.  This  broadening  of  opportunities  for 
demonstrating  achievement  stimulated  stu- 
dent motivation.  Students  liked  the  challenge 
and  seemed  eager  to  repeat  any  similar  pro- 
ject. A teacher  commented:  “There  wasn’t 
anyone  that  wouldn’t  do  it  again,  I don’t  think. 
They  realiv  liked  it.” 

Another  teacher  commented: 

“My  best  student  liked  being  ‘over  his  head.’ 
He  said,  ‘I  really  like  this’.  You  know,  the 
excitement  was  contagious  and  everybody  got 
into  it  and  they  had  fun.” 

Teachers  were  pleasantly  surprised  to  dis- 
cover how  focused  the  students  were: 

“I  almost  never  ever  had  to  talk  to  a group 
and  say,  ‘You  know  we’re  supposed  to  be  work- 
ing on  the  Millennium  Project’ .” 

Students  were  pleased  with  the  attention 
they  received  in  the  school: 

“They  felt  pleased  at  the  notoriety.  These 
kinds  of  kids  |i.e.,  applied]  don’t  get  in  the 
spotlight  very  much  and  so  they  felt  very 
pleased.  Plus  they  were  a very  endearing  group 
and  they  wanted  to  do  well.  They  wanted  to 
work  together  and  everything  was  going  to  be 
great,  and  it  w'as.” 


Teachers  commented  that  students  began  to 
acknowledge  their  own  potential  for  accom- 
plishment. Students  were  justifiably  impressed 
with  their  own  achievements: 

“Once  they  got  into  the  full  swing  of  it,  they 
realized  what  their  limitations  were  and  really 
how  much  more  capable  they  were  than  what 
they  thought  they  were.  [Initially]  they 
thought,  ‘Oh  forget  it,  there’s  no  way  we’re 
going  to  get  through  all  this’,  and  they  w^ere 
amazed  at  what  they  were  able  to  come  up 
wdth  in  20  days,  six  weeks  or  whatever.” 

As  a result,  students  did  not  want  to  work  on 
anything  else  but  the  project. 

The  Millennium  Project  gave  some  students 
who  normally  did  poorly  with  traditional  peda- 
gogy and  assessment  an  opportunity  to  excel. 
Teachers’  comments  included  the  following: 

“There  was  one  boy  who  had  the  computer 
skills.  So  his  marks  jumped  five  or  six  per  cent 
on  this  project.” 

“Students  had  an  opportunity  to  see  other 
students’  work.” 

“I  think  the  students  were  pretty  impressed 
with  their  peer’s  work.” 

The  Millennium  Project  empowered  stu- 
dents. Students  were  given  the  opportunity  to 
help  develop  rubrics  and  to  choose  their  own 
working  groups. 

Finally,  the  Millennium  Project  pointed  to 
new  paradigms  of  knowledge.  Performance- 
based  assessment  became  an  integrative  act 
that  asked  students  to  synthesize  the  diversity 
of  what  they  had  learned  and  to  apply  it.  This 
conceptual  framework  coincides  with  the 
constructivist  perception  (e.g. , Dewey)  of 
how  knowledge  is  best  acquired — that  is,  by- 
active  contact  with  that  knowledge  in  context 
and  use. 

In  the  Millennium  Project,  then,  the  stu- 
dents were  actively  and  authentically  learning 
within  a more  meaningful,  relevant  and  practi- 
cal context.  Learning  took  the  form  of  stu- 
dents actively  and  interactively  solving 
problems;  people  working  together;  students 
engaged  in  activities  driven  by  “essential 
knowledge”  that  was  meaningful  to  them; 
activities  that  were  cross-disciplined  and  con- 
nected; and  the  public  exhibition  of  their 
learning. 

Concluding  Comments 

Overall,  the  Project’s  DesignTeam  was  pleased 
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with  the  pilot  phase  of  the  Millennium  Project. 
The  year  ot  intense  planning,  preparation  and 
implementation  had  produced  commensurate 
benefits.  While  that  year  of  implementation 
provided  only  an  intermittent  view  ot  a highly 
complex  initiative,  it  became  evident  that  the 
project  showed  much  promise.  There  is 
undoubtedly  still  a considerable  amount  of 
work  to  be  done  before  the  next  phase  ot  the 
jtroject. 

The  project  was  successful  in  engaging 
teachers  in  thinking  and  talking  about  the 
process  of  instruction  and  their  assessment 
practices,  consideration  of  what  students 
should  be  expected  to  know  and  do  and  how- 
schools  can  work  successfully  with  others  in  the 
community.  Throughout  the  project,  there 
were  many  opportunities  for  both  teachers  and 
students  to  reflect,  question  and  learn  (Earl  & 
LcMahieu,  1 997).  In  essence,  teachers  saw  first 
hand  the  potential  available  when  letting  stu- 
dents define  and  determine  their  own  learning 
needs,  styles  and  processes. 

The  project  also  presented  a number  of 
challenges  for  many  teachers.  While  teachers 
globally  are  struggling  to  make  sense  of  avail- 
able alternative  assessment  choices  within  the 
current  political  climate  of  assessment  innova- 
tions, teachers  involved  in  the  project  soon 
discovered  that  performance-based  assessment 
is  a new  world  requiring  a new  kind  of  liter- 
acy. Performance-based  assessment,  as  viewed 
in  this  |)roject,  therefore,  challenged  teachers’ 
understanding  and  interpretations  about,  and 
their  professional  experiences  with,  assess- 
ment. Consequently  they  struggled  to  imjile- 
ment  innovative  assessment  practices  into 
their  classroom  routines. The  project  resulted 
in  profound  and  multi-faceted  change  and 
eagerness  on  the  part  of  teachers  to  let  us 


know-  about  their  efforts.  In  preparing  for  the 
next  phase  of  implementation,  a number  of 
issues  and  concerns  have  been  identified 
rec|uiring  further  attention: 

the  need  for  training  in  areas  related  to 
assessment,  including  how  to  report  on  stu- 
dent learning  (e.g. , should  evaluation  be 
anecdotal,  pass/fail,  levels,  or  a grade)  and 
issues  related  to  grading  (e.g.,  group  mark 
vs  individual  mark) 

the  need  to  collect  resources  in  advance,  to 
make  community  contact  in  advance  and  to 
ensure  the  availability  of  appropriate 
research  and  presentation  facilities 
the  need  to  provide  planned  opportunities 
(e.g. , in  earlier  grades  through  some  sort  of 
‘preservice’)  for  students  to  acquire  the 
skills  to  tlemonstrate  student  achievement 
successfully  (e.g.,  research  skills,  presenta- 
tion skills,  time  management  skills,  inter- 
view skills,  phone  skills) 
the  need  to  address  teachers’  concerns 
about  curriculum  coverage  so  that  they  arc 
not  ‘giving  up’  some  of  their  curriculum; 

^ the  need  to  provide  exemplars  to  be  used  in 
conjunction  with  rubrics 
the  need  to  facilitate  collaboration  with  out- 
side experts  (i.e.,  librarians,  community, 
businesses) 

the  need  to  address  issues  of  “control”  (see 
Damian  Coo|rer  & Nanci  Wakeman-jones’ 
article  in  this  Orhit  issue).  Q 
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Principles  for 

Fair  Student  Assessment 


WORKING  GROUP 


The  Principles  for  Fair  Student  Assessment  Prac- 
tices for  Education  in  Canada  was  developed 
by  a Working  Group  guided  by  a Joint  Advi- 
sory Committee. The  Committee  included 
representation  from  the  following  organi- 
zations: Canadian  Education  Association, 
Canadian  School  Boards  Association,  Cana- 
dian Association  for  School  Administra- 
tors, Canadian  Teachers’  Federation, 
Canadian  Guidance  and  Counselling  Asso- 
ciation, Canadian  Association  of  School 
Psychologists,  Canadian  Council  for 
Exceptional  Children,  Canadian  Psycho- 
logical Association,  and  Canadian  Society 


for  the  Study  of  Education,  and  the  Provin- 
cial and  Territorial  Ministries  and  Depart- 
ments of  Education. 

Financial  support  for  the  development 
and  dissemination  of  the  Principles  was 
provided  principally  hy  the  Walter  and 
Duncan  Gordon  Charitable  Foundation, 
with  additional  support  provided  hy  vari- 
ous faculties,  institutes,  and  colleges  of 
education  and  provin- 
cial and  territorial 
ministries  and  depart- 
ments of  education  in 
Canada. 


Tl  his  article  is  drawn  Irom  the  Principles 
for  Fair  Student  Assessment  Practices  for 
Education  in  Canada — a set  of  principles 
and  related  guidelines  generally  accepted 
by  professional  organizations  as  indicative  of 
fair  assessment  practice  within  the  Canadian 
educational  context.  Assessments  depend  on 
professional  judgment;  the  principles  and 
related  guidelines  highlighted  helow  identify 
the  issues  to  consider  in  exercising  this  profes- 
sional jutlgment  and  in  striving  tor  the  fair  and 
equitable  assessment  of  all  students.  The  com- 
plete  Principles,  which  contain  information  on 
summarizing  and  reporting  results  as  well  as 
presenting  assessment  information,  are  avail- 
able from  the  Centre  for  Research  in  Applied 
Measurement  and  Evaluation  at  the  Universi- 
ty ol  Alberta. ' 


I.  Developing  and  Choosing  Methods  for 
Assessment 

Assessment  methods  should  he  appropriate  for 
and  compatible  with  the  purpose  and  context  of 
the  assessment. 

.'\sse.ssment  method  is  used  here  to  refer  to  the 
various  strategies  and  techniques  that  teachers 
might  use  to  acquire  assessment  information. 
Fhese  strategies  and  techniques  include,  but 
are  not  limited  to,  observations,  text-  and  cur- 
rii  ulum-cmbeddod  questions  and  tests,  paper- 
and-pencil  tests,  oral  questioning,  benchmarks 
or  relerence  sets,  interviews,  |5ecr-and  self 
assessments,  standardized  cr  iter  ion -refer- 
enced and  norm-referenced  tests,  performance 
assessments,  writing  samples,  exhibitions, 
portlolio  assessment,  and  project  and  j^roduct 
assessments.  Sexeral  labels  have  been  used  to 
describe  subsets  of  these  alternatives,  u ith  the 
most  common  being  “direct  assessment,” 


“authentic  assessment, ’’“performance  assess- 
ment,” and  “alternative  assessment.”  How- 
ever, for  the  purpose  of  the  Principles,  the  term 
assessment  method  has  been  used  to  encom- 
])ass  all  the  strategies  and  techniques  that 
might  be  used  to  collect  information  from  stu- 
dents about  their  progress  toward  attaining  the 
knowledge,  skills,  attitudes,  or  behaviours  to 
he  learned. 

I.  Assessment  methods  should  be  developed 
or  chosen  so  that  injerences  drawn 
about  the  knowledge,  skills,  attitudes, 
and  behaviours  possessed  hy  each 
student  are  valid  and  not  open  to 
misintepretation. 

Validity  refers  to  the  degree  t(5  which  infer- 
ences drawn  Irom  assessments  results  arc 
meaningful. Therefore,  development  or  selec- 
tion of  assessment  methods  for  collecting 
inlormation  should  be  clearly  linked  to  the 
purposes  for  which  inferences  and  decisions 


are  to  he  made,  for  example,  to  monitor  the 
progress  of  students  as  proofreaders  and  edi- 
tors of  their  own  work,  it  is  better  to  assign  an 
actual  writing  task,  to  allow  time  and 
resources  for  editing  (dictionaries,  handbooks, 
etc.),  and  to  observe  students  for  evidence  of 
proofreafling  and  editing  skills  as  they  work 
than  to  use  a test  containing  discrete  items  on 
usage  and  grammar  that  are  relatively  devoid 
of  context. 

2.  Assessment  methods  should  he  clearly 
related  to  the  goals  and  objectives  of 
instruction,  and  be  compatible  with  the 
instructional  approaches  used. 

To  enhance  validity,  assessment  methods 
should  be  in  harmony  \vith  the  instructional 
objectives  to  which  they  arc  referenced. 
Planning  an  assessment  design  at  the  same 
time  as  planning  instruction  will  help  integrate 
the  two  in  meaningful  ways.  Such  joint 
planning  provides  an  overall  perspective  on  the 
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Planning  an  assessment  design  at 


the  same  time  as  planning  instruction 


will  help  integrate  the  two  in 


meaningful  ways. 


knowledge,  skills,  attitudes,  and  behaviours 
to  be  learned  and  assessed,  and  the  contexts 
in  which  thev  will  be  learned  and  assessed. 

i.  When  developing  or  choosing  assessment 
methods,  consideration  should  be  given 
to  the  consequences  of  the  decisions  to 
be  made  in  Ught  oj  tbe  obtained 
information. 

The  outcomes  of  some  assessments  may 
be  more  critical  than  others.  For  example, 
misinterpretation  of  the  level  of  performance 
on  an  end-of~unit  test  may  result  in  incorrect- 
ly holding  a student  from  proceeding  to  the 
next  instructional  unit  in  a continuous 
progress  situation.  In  such  “high-stake”  situa- 
tions, every  effort  should  be  made  to  ensure 
the  assessment  method  will  yield  consistent 
and  valid  results.  “Low  stake”  situations, 
such  as  determining  if  a student  has  correctly 
completed  an  in-class  assignment,  can  be 
less  stringent.  Low  stake  assessments  are 
often  repeated  during  the  course  of  a report- 
ing period  using  a variety  of  methods.  If  the 
results  are  aggregated  to  form  a summary 
comment  or  grade,  the  summary  will  have 
greater  consistency  and  validity  than  its 
component  elements. 


4.  More  than  one  assessment  method  should 
be  used  to  ensure  comprehensive  and 
consistent  indications  of  student  perfor- 
mance. 

To  obtain  a more  complete  picture  or  profile 
of  a student’s  knowledge,  skills,  attitudes,  or 
behaviours,  and  to  discern  consistent  patterns 
and  trends,  more  than  one  assessment  method 
should  be  used.  Student  knowledge  might  be 
assessed  using  completion  items;  process  or 
reasoning  skills  might  be  assessed  by  observing 
performance  on  a relevant  task;  evaluation 
skills  might  be  assessed  by  rellecting  upon  the 
discussion  with  a student  about  what  materials 
to  include  in  a portfolio.  Self-assessment  may 
help  to  clarify  and  add  meaning  to  the  assess- 
ment of  a written  communication,  science 
project,  piece  of  art  work,  or  an  attitude.  Use 
of  more  than  one  method  will  also  heljj  mini- 
mize inconsistency  brought  about  by  different 
sources  of  measurement  error  (for  example, 
poor  performance  because  of  an  “off-day”;  lack 
of  agreement  among  items  included  in  a test, 
rating  scale,  or  c|uestionnaire;  lack  of  agree- 
ment among  observers;  instability  across 
time). 

5.  /Issessment  methods  should  be  suited  to 
the  backgrounds  and  prior  experiences  of 
studen  ts. 

Assessment  methods  should  be  free  from  bias 
brought  about  by  student  factors  extraneous 
to  the  purpose  of  the  assessment.  Possible  fac- 
tors to  consider  include  culture,  developmen- 
tal stage,  ethnicity,  gender,  socio-economic 
background,  language,  special  interests,  and 
special  needs.  Students’  success  in  answering 
questions  on  a test  or  in  an  oral  quiz,  tor 
example,  should  not  be  dependent  upon  prior 
cultural  knowledge,  such  as  understanding  an 
allusion  to  a cultural  tradition  or  value,  unless 
such  knowledge  falls  within  the  content 
domain  being  assessed.  All  students  should  be 
given  the  same  opportunity  to  display  their 
strengths. 

6.  Content  and  language  that  would  gener- 
ally be  viewed  as  sensitive,  sexist,  or  offen- 
sive should  be  avoided. 

The  vocabulary  and  problem  situation  in  each 
test  item  or  performance  task  should  not 


favour  or  discriminate  against  any  group  of  stu- 
dents. Steps  should  be  taken  to  ensure  that 
stereotyping  is  not  condoned.  Language  that 
might  be  offensive  to  particular  groups  of  stu- 
dents should  be  avoided.  A judicious  use  of  dif- 
ferent roles  for  males  and  females  and  for 
minorities  and  the  careful  use  of  language 
should  contribute  to  more  effective  and, 
therefore,  fairer  assessments. 

7.  Assessment  instruments  translated  into 
a second  language  or  transferred  from 
another  context  or  location  should  be 
accompanied  by  evidence  that  inferences 
based  on  these  instruments  are  valid  for 
the  intended  purpose. 

Translation  of  an  assessment  instrument  from 
one  language  to  another  is  a complex  and 
demanding  task.  Similarly,  the  adoption  or 
modification  of  an  instrument  developed  in 
another  country  is  often  not  simple  and 
straightforward.  Care  must  be  taken  to  ensure 
that  the  results  from  translated  and  imported 
instruments  are  not  misinterpreted  or  mis- 
leading. 


II.  Collecting  Assessment  Information 

Students  should  be  provided  with  a sufficient 
opportunity  to  demonstrate  the  knowledge, 
skills,  attitudes,  or  behaviours  being  assessed. 

Assessment  information  can  be  collected  in  a 
variety  of  w'ays  (observations,  oral  question- 
ing, interview's,  oral  and  written  reports, 
paper-and-pencil  tests). The  guidelines  which 
follow  are  not  all  equally  applicable  to  each  of 
these  procedures. 

1.  Students  should  be  told  why  assessment 
information  is  being  collected  and  how 
this  information  will  be  used. 

Students  w'ho  know  the  purpose  of  an  assess- 
ment are  in  a position  to  respond  in  a manner 
that  will  provide  information  relevant  to  that 
purpose.  For  example,  if  students  know  that 
their  participation  in  a group  activity  is  to  be 
used  to  assess  cooperative  skills,  they  can  be 
encouraged  to  contribute  to  the  activity.  If 
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When  students  know  that  the  purpose 
of  an  assessment  is  to  diagnose 
strengths  and  weaknesses, . . . they  can 
he  encouraged  to  reveal  weaknesses 
as  well  as  strengths. 

students  know  that  the  purpose  ot  an  assess- 
ment is  to  diagnose  strengths  and  weaknesses 
rather  than  to  assign  a grade,  they  can  be 
encouraged  to  reveal  weaknesses  as  well  as 
strengths.  It’ the  students  know  that  the  pur- 
pose is  to  assign  a grade,  they  are  well  advised 
to  respond  in  a wav  that  will  maximize 
strengths.  This  is  especially  true  for  assess- 
ment methods  that  allow  students  to  make 
choices,  such  as  with  optional  writing  assign- 
ments or  research  projects. 

2.  An  assessment  procedure  should  he  used 
under  conditions  suitable  to  its  purpose 
and  form. 

Optimum  conditions  should  he  provided  lor 
obtaining  data  from  and  information  about  stu- 
dents so  as  to  maximize  the  validity  and  consis- 
tency ol  the  data  and  information  collected. 
Common  conditions  include  such  things  as 
proper  light  and  ventilation,  comfortahle  room 
temperature,  and  freedom  from  distraction 
(e.g. , movement  in  and  out  ol  the  room,  noise). 
Adecjuate  workspace,  sufficient  materials,  and 
adequate  time  limits  airprojrriate  to  the  purpose 
and  form  of  the  assessment  are  also  necessarv. 
For  example,  if  the  intent  is  to  assess  student 
participation  in  a small  group,  adequate  work 
space  shoidd  be  provided  for  each  student 
group,  with  suHicient  space  between  subgroups 
so  that  the  groups  do  not  interfere  with  or  oth- 
erwise inlluence  one  another  and  so  that  the 
teacher  has  the  same  opportunity  to  observe 
and  assess  each  student  within  each  group. 

3.  In  assessments  involving  observations, 
checklists,  or  rating  scales,  the  number  of 
characteristics  to  he  assessed  at  one  time 
should  he  small  enough  and  concretely 
described  so  that  the  observations  can  be 
made  accuratelv. 


Student  behaviours  often  change  so  rapidly 
that  it  may  not  be  possible  simultaneously  to 
observe  and  record  all  the  behaviour  compo- 
nents. In  such  instances,  the  number  of  com- 
ponents to  be  observed  should  be  reduced  and 
the  components  should  be  describetl  as  con 
cretely  as  possible.  One  way  to  manage  an 
observation  is  to  divide  the  behaviour  into  a 
series  of  components  and  assess  each  compo- 
nent in  sequence.  Bv  limiting  the  number  of 
components  assessed  at  one  time,  the  data  and 
information  become  more  focused,  and  time  is 
not  spent  obser\  ing  later  behaviour  until  pre- 
requisite behaviours  are  achieved. 

4.  The  directions  provided  to  students 
should  be  clear,  complete,  and  appropri- 
ate for  the  ability,  age  and  grade  level  of 
the  students. 

Lack  of  understanding  of  the  assessment  task 
may  prevent  maximum  performance  or  display 
of  the  behaviour  called  for.  In  the  case  of  timed 
assessments,  for  example,  teachers  should 
describe  the  time  limits,  explain  how  students 
might  distribute  their  time  among  parts  for 
those  assessment  instruments  with  parts,  and 
describe  how  students  should  record  their 
responses.  For  a portfolio  assessment,  teachers 
should  describe  the  criteria  to  be  used  to  select 
the  materials  to  be  included  in  a portfolio,  who 
will  select  these  materials,  and,  if  more  than 
one  person  will  be  involved  in  the  selection 
process,  how  the  judgments  from  the  different 
people  will  be  combined.  Where  apjrropriatc, 
sample  material  and  practice  should  be  provid- 
ed to  further  increase  the  likelihood  that 
instructions  will  be  understood. 

5.  In  assessments  involving  selection  items 
(e.g.,  true  /false,  multiple  choice),  the 
directions  should  encourage  students  to 
answer  all  items  without  threat  of  penalty. 

A correction  formula  is  sometimes  used  to 
discourage  “guessing”  on  selection  items. 
The  formula  is  intended  to  encourage  students 
to  omit  items  for  which  thev  do  not  know  the 
answer  rather  than  to  “guess”  the  answer. 
Because  research  evidence  indicates  that  the 
benefits  expected  from  the  correction  are  not 
realized,  the  use  of  the  formula  is  discouraged. 
Students  should  be  encouraged  to  use  what- 


ever partial  knowledge  they  have  when 
choosing  their  answers,  and  to  answer  all 
items. 

6.  When  collecting  assessment  informa- 
tion, interactions  with  students  should  be 
appropriate  and  consistent. 

Care  must  be  taken  when  collecting  assess- 
ment information  to  treat  all  students  fairly. 
For  example,  when  oral  presentations  by  stu- 
dents are  assessed,  questioning  and  probes 
should  be  distributed  among  the  students  so 
that  all  students  have  the  same  o]:>portunity  to 
demonstrate  their  knowledge.  While  writing  a 
pajjer-and-pencil  test,  a student  may  ask  to 
have  an  ambiguous  item  clarified,  and,  if  war- 
ranted, the  item  should  be  explained  to  the 
entire  class. 

7.  Unanticipated  circumstances  that 
interfere  with  the  collection  of  assess- 
ment information  should  be  noted  and 
recorded. 

Events  such  as  a fire  drill,  an  unscheduled 
assembly,  or  insufficient  materials  may 
interfere  in  the  way  in  which  assessment 
information  is  collected.  Such  events  should 
be  recorded  and  subsequently  considered 
when  interpreting  the  inlormation  obtained. 

8.  A written  policy  should  guide  decisions 
about  the  use  of  alternate  procedures 
for  collecting  assessment  information 
from  students  with  special  needs  and 
students  whose  proficiency  in  the  lan- 
guage of  instruction  is  inadequate  for 
them  to  respond  in  the  anticipated 
manner. 

It  may  be  necessary  to  tlevelop  alternative 
assessment  procedures  to  ensure  a consistent 
and  valid  assessment  of  those  students  who, 
because  of  special  needs  or  inadequate  lan- 
guage, arc  not  able  to  respond  to  an  assessment 
method  (for  example,  oral  instead  of  written 
format,  individual  instead  of  group  adminis- 
tered, translation  into  first  language,  providing 
additional  time).  The  use  of  alternate  proce- 
dures should  be  guided  by  a written  poliev 
developed  b\’  teachers,  administrators,  and 
other  jurisdictional  personnel. 
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III.  Judging  and  Scoring  Student 
Performance 

Procedures  for  judging  or  scoring  student 
performance  should  be  appropriate  for  the 
assessment  method  used  and  be  consistently 
applied  and  monitored. 

judging  and  scoring  refers  to  the  process  of 
determining  the  cpiality  of  a student’s  perfor- 
mance, the  appropriateness  of  an  attitude  or 
behaviour,  or  the  correctness  of  an  answer. 
Results  derived  from  judging  and  scoring  may 
be  expressed  as  written  or  oral  comments,  rat- 
ings, categorizations,  letters,  numbers,  or  as 
some  combination  of  these  forms. 

1.  Before  an  assessment  method  is  used,  a 
procedure  for  scoring  should  be  prepared 
to  guide  the  process  of  judging  the  quality 
of  a performance  or  product,  the  appro- 
priateness of  an  attitude  or  behaviour,  or 
the  correctness  of  an  answer. 

To  increase  consistency  and  validity,  properly 
developed  scoring  procedures  should  be 
used.  Diherent  assessment  methofls  require 
different  forms  of  scoring.  Scoring  selection 
items  (true /false,  multiple  choice,  matching) 
requires  the  identification  of  the  correct  or,  in 
some  instances,  best  answer.  Guides  for  scor- 
ing essays  might  include  factors  such  as  the 
major  points  to  be  included  in  the  “best 
answer”  or  models  or  exemplars  correspond- 
ing to  different  levels  of  performance  at  differ- 
ent age  levels  and  against  which  comparisons 
can  be  made.  F^rocedures  for  judging  other 
performances  or  products  might  include  spec- 
ification of  the  characteristics  to  be  rated  in 
performance  terms  and,  to  the  extent  possi- 
ble, clear  descriptions  of  the  different  levels  of 
performance  or  quality  of  a product. 

2.  Before  an  assessment  method  is  used, 
students  should  be  told  how  their 
responses  or  the  information  they  provide 
will  be  judged  or  scored. 

Informing  students  prior  to  the  use  of  an 
assessment  method  about  the  scoring  proce- 
ilures  to  be  followed  should  help  ensure  that 
similar  expectations  arc  hchl  by  both  students 
and  their  teachers. 


3.  Care  should  be  taken  to  ensure  that  results 
are  not  influenced  by  factors  that  are  not 
relevant  to  the  purpose  of  the  assessment. 

Various  types  of  errors  occur  in  scoring,  par- 
ticularly when  a degree  of  subjectivity  is 
involved  (e.  g. , marking  essays,  rating  a perfor- 
mance, judging  a debate).  For  example,  if  the 
intent  of  a written  communication  is  to  assess 
content  alone,  the  scoring  should  not  be  influ- 
enced by  stylistic  factors  such  as  vocabulary 
and  sentence  structure.  Personal  bias  errors 
are  indicated  by  a general  tendency  to  rate  all 
students  in  approximately  the  same  way  (e.  g. , 
too  generously  or  too  severely).  Halo  effects 
can  occur  when  a rater’s  general  impression  of 
a student  influences  the  rating  of  individual 
characteristics  or  when  a previous  rating  influ- 
ences a subsequent  rating.  Pooled  results  from 
two  or  more  independent  raters  (teachers, 
other  students)  will  generally  produce  a more 
consistent  description  of  student  performance 
than  a result  obtained  from  a single  rater.  In 
combining  results,  the  personal  biases  of  indi- 
vidual raters  tend  to  cancel  one  another. 

4.  Comments  formed  as  part  of  scoring 
should  be  based  on  the  responses  made  by 
the  students  and  presented  in  a way  that 
students  can  understand  and  use  them. 

Comments,  in  oral  and  written  form,  are  pro- 
vided to  encourage  learning  and  to  point  out 
correctable  errors  or  inconsistencies  in  perfor- 
mance. In  addition,  comments  can  be  used  to 
clarify  a result.  Such  feedback  should  be  based 
on  evidence  pertinent  to  the  learning  out- 
comes being  assessed. 

5.  Any  changes  made  during  scoring  should 
be  based  upon  a demonstrated  problem 
with  the  initial  scoring  procedure.  The 
modified  procedure  should  then  be  used 
to  rescore  all  previously  scored  responses. 


Anticipating  the  full  range  of  student  respons- 
es is  a dif  ficult  task  for  several  forms  of  assess- 
ment. There  is  always  the  danger  that 
unanticipated  responses  or  incidents  that  are 
relevant  to  the  purposes  of  the  assessment  may 
be  overlooked.  Consequently,  scoring  should 
be  continuously  monitored  for  unanticipated 
responses  and  these  responses  should  be  taken 
into  proper  account. 

6.  An  appeal  process  should  be  described  to 
students  at  the  beginning  of  each  school 
year  or  course  of  instruction  that  they 
may  use  to  appeal  a result. 

Situations  may  arise  where  a student  believes 
a result  incorrectly  reflects  his/her  level  of 
performance.  A procedure  by  which  students 
can  appeal  such  a situation  should  be  deve- 
loped and  made  known  to  them. This  proce- 
dure might  include,  for  example,  checking  for 
addition  or  other  recording  errors  or,  perhaps, 
judging  or  scoring  by  a second  qualified 
person.  Q 
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Standards  of 
Practice  and 
Assessment 


Fran  Squire,  Allan  Craig,  and 
DougWilson 


Classroom 


Standards  of  Practice  and  classroom 
assessment?  What  is  the  connection  for 
me  as  an  educator?  What  do  the  Stan- 
dards of  Practice  for  the  Teaching  Profession 
have  to  say  about  student  assessment?  In 
answering  these  questions,  we  will  focus  on 
the  mandate  of  the  Ontario  College  ofTeach- 
ers  and  its  role  as  the  self-regulatory  body  for 
the  teaching  profession.  We  begin  by  setting  a 
background  context  tor  the  College,  describ- 
ing what  the  standards  arc  and  what  they  are 
not,  and  outline  how  assessment  is  addressed 
in  the  standards  of  |rractice. 

The  Ontario  College  ofTeachers  was  creat- 
ed in  I 996  to  license,  govern  anti  regulate  the 
practice  of  teaching  in  the  jirovince.  The 
175,000  members  of  the  College  include 
classroom  teachers,  administrators,  superin- 
tendents, and  those  who  hold  Ontario  teach- 
ing qualifications  in  other  educational 
organizations.  An  important  part  of  the  Col- 
lege’s mandate  is  to  provide  leadership  to  the 
profession  in  developing  standards  of  |rractice, 
ethical  standards,  and  a framework  for  career 
long  ])rofessional  learning.  The  Standards  of 
Practice  for  the  Teaching  Profession,  developed 
over  the  past  two  years  with  substantial  input 
Irom  educators  and  the  public,  are  organized 
in  live  statements.  Kev  elements  exjDand  on 
aTid  describe  each  of  these  statements,  (see 
chart). 

What  do  the  standards  of  practice 
have  to  do  with  me? 

.As  a self-regulatory  bodv,  the  Ontario  College 
ol  leachers  must  articulate  for  its  members 
and  the  public  w hat  it  is  that  makes  the  teach- 
ing jrrotessiern  unique.  \\  hat  know  ledae,  skills. 


As  prt^essionals,  College  members 
must  know  multiple  ways  to 
assess  and  evaluate  students. 


and  values  do  teachers  have  as  professionals? 
Why  can’t  any  other  caring  adult  w'ho  has  a 
university  degree  be  designated  “a  teacher”? 
Professional  self-regulatory  bodies  use  the 
term  “standards  of  |rractice”  to  refer  to  the 
descriptors  which  answ'er  these  questions. 

The  standards  of  jrractice,  developed  for  the 
teaching  jirofession,  are  interdependent 
descriptors  for  the  profession  as  a w hole.  For 
example,  the  College  has  legislative  responsi- 
bility for  the  accreditation  of  pre-service  pro- 
grams at  the  faculties  of  education.  This 
process  ensures  that  pre-service  programs  are 
designed  to  support  the  Standards  of  Practice  for 
theTeaching  Profession.  As  a second  example,  the 
College  will  also  accredit  in-service  profes- 
sional learning  programs  within  Regulation 
184/97.  This  regulation  includes  programs 
such  as  the  Additional  Qualification  courses 
and  Principal’s  Qualification  Program.  An 
important  function  of  the  standarfls  of  prac- 
tice, then,  is  to  assure,  through  the  accredita- 
tion process,  quality  professional  learning  for 
College  members. 

Although  the  standards  of  practice  are 
descriptors  for  the  profession,  individuals  also 
personalize  the  standards  and  recognize  them- 
seb  es  and  the  work  they  do  as  educators.  Many 
members  of  the  College  are  using  the  stan- 
dards to  reflect  on  their  practice  and  plan  their 
own  professional  growth. 


Can  the  Standards  of  Practice  for  the 
Teaching Professionhe  used  in  performance 
appraisals  of  teachers  and  administrators? 

Performance  appraisal  remains  the  responsi- 
bility of  the  employer.  The  standards  of  prac- 
tice were  not  developed  to  be  criteria  for  the 
evaluation  of  individual  members.  They  are 
broad  descriptors  for  the  profession,  not  a 
checklist  of  competency  skills  to  be  measured. 
On  the  other  hand,  the  College  is  aware  that 
the  standards  are  being  considered  as  a founda- 
tion by  some  employers  as  their  appraisal  poli- 
cies and  procedures  are  reviewed. 

As  w'ritten,  the  standards  are  not  specified 
in  detail  for  the  varying  roles  within  the  pro- 
fession, nor  do  they  describe  individual  con- 
texts. All  educators  are  encouraged  to 
understand  and  extend  the  standards  within 
their  specific  roles,  using  them  as  a guide  for 
their  professional  growth  and  practice.  What 
do  the  standards  sav  about  this  professional 
growth  and  practice  in  the  area  of  classroom 
assessment? 

What  do  the  Standards  of  Practice  for  the 
Teaching  Profession  say  about  classroom/ 
student  assessment? 

Specific  references  to  assessment  are  found  in 
the  key  elements  of  Professional  Know  ledge 
andTeaching  Practice. These  elements  describe 
the  general  exj^ectations  for  teaching  within 
the  field  of  student  assessment. 

Professional  Knowledge 

Members  oj  the  Ontario  College  ofTeachers 
know  ways  to: 

(a)  assess  and  evaluate  student  learning, 
student  ajjproaches  to  learning  and  the 
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Standards  and  Principles 


STANDARDS  DF  PRACTICE  FOR  THE  TEACHING  PROFESSION 


Commitment  to  Students  and 
Student  Learning 

Members  of  the  Ontario  College  ofTeachers 
demonstrate  care  for  and  commitment  to 
students.  They  are  dedicated  to  engaging 
and  supporting  student  learning.  Teachers 
treat  students  equitably  and  with  respect. 
They  encourage  students  to  grow  as  indi- 
viduals and  as  contributing  members  of 
society.  Teachers  assist  students  to  become 
life-long  learners. 

Professional  Knowledge 
Professional  knowledge  is  the  foundation 
for  teaching  practice.  Members  of  the 
Ontario  College  ofTeachers  know  the  cur- 
riculum, the  subject  matter,  the  student, 
and  teaching  practice.  They  know  educa- 
tion-related legislation,  methods  for  com- 
munication, and  ways  to  teach  in  a changing 
world. 

Teaching  Practice 

Members  of  the  Ontario  College  ofTeachers 
apply  professional  knowledge  and  under- 
standing of  the  student,  curriculum,  teach- 
ing, and  the  changing  context  of  the 


learning  environment  to  promote  student 
learning.  They  conduct  ongoing  assessment 
and  evaluation  of  student  progress.  Teachers 
modify  and  refine  teaching  practice 
through  continuous  reflection. 

Leadership  and  Community 
Members  of  the  Ontario  College  ofTeachers 
are  educational  leaders  who  create  and  sus- 
tain learning  communities  in  their  class- 
rooms, in  their  schools,  and  in  their 
profession. They  collaborate  with  their  col- 
leagues and  other  professionals,  with  par- 
ents, and  wdth  other  members  of  the 
community  to  enhance  school  programs 
and  student  learning. 

Ongoing  Professional  Learning 
Members  of  the  Ontario  College  of 
Teachers  are  learners  who 
acknowledge  the  interdepen- 
dence of  teacher  learning  and  stu- 
dent learning.  Teachers  engage  in 
a continuum  of  professional 
grow'th  to  improve  their  practice. 


achievement  of  curriculum  expecta- 
tions; 

Teaching  Practice 

Assessment  and  evaluation  of  students 

Members  of  the  Ontario  College  ofTeachers: 

(a)  communicate  clear,  challenging  and 
achievable  expectations  for  students; 

(b)  gather  data  on  student  performance 
using  a variety  of  assessment  strategies; 

(c) keep  a continuous  and  comprehensive 
record  of  group  and  individual  achieve- 
ment; and 

(d)  report  and  j^roviile  ongoing  feedback  of 
individual  achievement  to  students  and 
parents. 

The  purpose,  then,  of  the  Standards  of 
Practice  for  theTeaching  Profession  is  to  outline 
broad  areas  and  underlying  [principles  of 
assessment  from  which  teachers  may  expand 
the  details  for  their  particular  role  and  in 


their  particular  context.  During  the  develop- 
ment and  writing  of  the  standards,  educators 
described  what  was  important  to  them  in  the 
area  of  student  assessment.  Many  teachers 
across  Ontario  identified  key  elements  and 
how  they  were  integrated  into  their  teaching 
practice.  Much  of  this  input  was  supported 
by  current  literature  and  research  on  class- 
room assessment  as  the  standards  document 
was  created. 

Teachers  also  reported  a strong  connection 
between  assessment  and  ongoing  professional 
learning.  They  stated  that  their  current  profes- 
sional learning  was  often  focussed  on  expand- 
ing their  repertoire  of  assessment  strategies 
and  communicating  to  parents  the  new  strate- 
gies and  results  of  initiatives  such  as  the 
EQAO  testing.  This  professional  learning 
involves  formal  courses  and  collaborative 
“learning  in  practice”  strategics  such  as  men- 
toring, action  research  and  school  improve- 
ment plans. 


How  are  College  members  interpreting 
assessment  in  the  standards  of  practice? 

An  elementary  principal  in  one  of  the 
College’s  research  case  studies  captures  the 
essence  of  what  the  standards  say  about  class- 
room/ student  assessment. 

“The  Standards  are  almost  a blueprint 
to  help  me  in  my  job  in  supporting  teachers 
in  what  they  do — inside  a classroom. 
My  philosophical  belief  is  that  planning  and 
student  assessment  is  the  key  to  student 
achievement. This  is  truly  an  outline  for  how'  I 
can  help  teachers  help  students  to  achieve  the 
curriculum  expectations  that  are  expected 
of  us.” 

A teacher  candidate  in  a pre-service  pro- 
gram articulates  her  understanding  of  the  links 
betw'een  classroom  assessment  and  the  stan- 
dards of  practice. 

“Assessment  and  evaluation  play  a very 
significant  role  in  the  teaching  profession,  and  I 
learned  how  to  effectively  communicate  clear 
and  challenging  expectations  to  my  students.  I 
used  a variety  of  assessment  strategies 
throughout  the  unit  and  kept  a continuous 
record  of  group  and  individual  work  samples. 
My  students  were  given  clear  expectations 
wdiich  I know  kept  them  focussed,  motivated, 
and  goal-orientated  towards  working  at  the 
level  3 and  4 expectations.  Rubrics  provide 
students  with  the  foundation  to  know  what  is 
expected  of  them  and  to  become  self-directed 
in  their  learning.” 

An  experienced  teacher  uses  the  standards 
of  practice  as  she  thinks  about  accountability 
and  communicating  student  achievement  to 
parents. 

“I’m  thinking  about  doing  report  cards  and 
how  to  get  my  whole  program  together  so  that 
when  I am  presenting  assessment  and  evalua- 
tion to  [parents  and  students,  I have  something 
that's  ongoing  and  its  consistent. They  can  see 
where  I’m  coming  from  and  how  the  steps  fol- 
low. Some  of  my  colleagues  have  taken  this  on 
and  it  looks  great  and  it  links  directly  into  the 
standards  as  well.” 

From  the  preliminary  research  in  terms  of 
validating  the  standards,  it  has  been  interesting 
to  note  how  assessment  is  currently  a high  pri- 
ority for  educators.  For  example.  Additional 
Qualification  course  participants  have  request- 
ed a greater  emphasis  on  classroom  assessment 
being  cncorporated  into  course  design.  The 
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significance  of  ongoing  professional  learning 
regarding  assessment  at  the  school  and  system 
levels  is  reflected  in  part  by  the  articles  within 
this  special  issue  of  Orbit  that  highlight  specific 
assessment  strategies. 

Returning  to  the  opening  c|ucstions,  class- 
room assessment  is  an  integral  part  of 
the  Standards  of  Practice  for  theTeacbing  Profes- 
sion, as  outlined  in  the  key  elements.  As  pro- 
fessionals, College  members  must  know 
multiple  ways  to  assess  and  evaluate  students. 
They  must  be  able  to  carry  out  in  practice  the 
skills  of  data  gathering,  record  keeping,  com- 
municating clear  expectations,  and  reporting 
achievements  to  students  and  jtarents.  The 
Standards  of  Practice  .for  the  Teaching  Projession 
provide  a foundation  for  pre-service  and 
in-service  programs  ensuring  that  both 
new  and  experienced  teachers  acquire  the 
knowledge,  skills  and  values  related  to  student 
assessment. The  standards  [provide  a common 
language  for  members  at  all  phases  in  their 
prolcssional  careers  to  “assess”  their  assess- 
ment jU'actice.s.  By  determining  their  own 
routes  of  professional  learning  teachers  can 
make  the  professional  decisions  about  changes 
in  jiracticc  that  enhance  student  learning,  and 
in  doing  so,  reinforce  the  most  important 
standard,  commitment  to  students  and  student 
learning.  O 
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© OISE/UT  'Adynamic  school  district/university  partnership 
helping  to  shape  the  future  of  education 


CALL  FOR  PROPOSALS 


DEADLINE  JULY  15,2000 


The  Learning  Consortium  is 
inviting  presentation  proposals 
for  our  7th  annual  Assessment 
and  Learning  Conference  to 
be  held  at  the  Sheraton  Centre 
in  downtown  Toronto,  Friday, 
February  2 and  Saturday, 
February  3,  2001. 

This  year's  conference  theme  is 
QUALITY  LEARNING  ENVIRON- 
MENTS. The  strands  of  this 
theme  are: 


and/or  lunch  allowance  on 
Saturday 

• substitute  teacher  costs  for 
Friday,  if  required. 

• honorarium  of  $150.00  CDN  for 
those  presenting  on  Saturday 
only 

• session  handouts  photocopied 
and  included  in  conference 
handbook 

• transportation  and  accommo- 
dation costs  where  required. 


1 . Building  the  bridge  between 
curriculum  and  learning  to 
assessment  and  reporting. 

2.  Multiple  intelligences  and 
the  individual  learner. 

3.  The  assessment  literate  school 
(elementary  & secondary). 

4.  Effective  team  players 
(the  role  of  principal, 
teacher  St  student). 

5.  Preparing  for  high  stakes 
testing  (a  brain  based 
teaching  approach). 

6.  The  motivational  learner. 


In  recognition  of  your  90  minute 
to  2 hour  presentation,  we 
provide  your: 

• conference  registration 
(approx.  $300  value) 

• sit  down  lunch  on  Friday 


The  breakout  sessions  will 
deliver  practical  approaches 
to  building  quality  learning 
learning  environments  around 
the  above  themes.  We  are 
asking  keynote  speakers  to 
offer  a breakout  session  also 
and/or  to  be  available  at  the 
close  of  the  day  to  bring  it  all 
together  in  an  interactive 
feedback  or  panel  session. 

Keynote  speakers  are  yet  to  be 
confirmed  but  will  include 

Ruth  Sutton,  Dr.  Rick  Stiggins 
and  Dr.  Carol  Rolheiser. 

If  you  are  interested  in  being 
considered  as  presenter  at 
our  conference,  please  call  us  at 
(416)  923-6641  X 681 2 by 
July  1 5,  2000  to  receive  a 
"Call  for  Presenters"  form. 


Fran  Squire  and  Allan  Craig  are  Program  Officers 
of  the  Professional  Affairs  Department.  Doug 
Wilson  is  Manager,  Standards  of  Practice  and 
Education  Unit,  Ontario  College  of  Teachers. 
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More  information  at  fcis.oise.utoronto.ca/~learning 
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Standards  and  Principles 


Moving  Towards 
A Culture  of 
Assessment 


. . we  must  rely  on  a combination  of  high  quality 
standardized  tests  and  high  quality  classroom  assess- 
ment. . .only  through  this  combination  can  webring  the 
true  power  erf  assessment  to  bear  in  the  pursuit  of  educa- 
tional excellence.  ..."  -Rick  Stiggins 

In  this  article  we  will  summarize  our  expe- 
riences as  we  embark  on  a journey  to  create 
a culture  of  assessment  in  every  classroom 
of  our  board.  We  will  explore  the  thoughts 
ot  principals  and  teachers  who  are  becoming 
assessment  literate  and  are  beginning  to  ques- 
tion their  assessment  practices  and  to  chal- 
lenge their  colleagues  to  do  the  same.  We  will 
briefly  outline  our  hoard’s  action  plan,  our 
progress,  and  our  challenges. 

Commitment 

Considering  the  role  of  the  EQAO  in  provid- 
ing large-scale  assessment  information  and 
recognizing  the  power  of,  and  need  for,  high- 
quality  classroom  assessment,  the  York  Region 
District  School  Board  underscored  its  com- 
mitment to  creating  a culture  of  assessment  by 
assigning  a principal  to  the  position  of  Assess- 
ment and  Evaluation  Project  Leader  last 
February  (1999).  This  person  was  charged 
with  the  task  of  implementing  a regional 
Assessment  Training  Program  (ATP)  and  lead- 
ing the  development  of: 

a board  pcjlicy  on  assessment  and  a profile  of 
assessment  competencies  for  teachers  and 
administrators 

^ a resource  kit  of  assessment  literature  and 
guides  to  support  the  development  and  use 
of  effective  assessment  practices 


^ instruments  which  would  enable  teachers 
and  school  administrators  to  assess  their 
level  of  implementation  of  effective  assess- 
ment practices 

^ school-based  learning  teams  that  would 
support  the  development  of  assessment  lit- 
eracy in  their  schools 

Vision 

We  began  our  journey  by  articulating  a vision 
for  effective  assessment  practices  in  our 
schools  where  “every  teacher  and  principal 
invests  the  time  and  energy  needed  to  become 
assessment  literate,  and  to  develop  the  skills 
necessary  to  ensure  that  all  classroom  assess- 
ments meet  the  Guiding  Principles  and  Standards 
of  High  Quality  Assessment." 

The  Plan  Takes  Shape 

A key  aspect  of  our  two-year  action  plan  was 
the  creation  of  a leadership  team  consisting  of 
one  teacher  and  one  administrator  from  each 
of  seven  schools  across  the  board  (four  ele- 
mentary and  three  secondary).  In  the  first  year, 
while  we  were  developing  the  ATP,  members 
of  our  team  would,  through  professional 
development,  personal  study,  and  interaction 
and  reflection  with  their  colleagues,  develop 
high  levels  of  assessment  literacy.  They  also 
provided  leadership  to  others  on  their  school 
learning  teams,  and  they  developed  and  piloted 
materials  to  support  the  use  of  sound  assess- 
ment practices  in  their  classrooms.  During  the 
first  year,  an  assessment  policy  was  developed, 
and  awareness  sessions  conducted  for  teachers 
and  administrators  regarding  the  goals  and 
plans  for  the  ATP. 

In  the  second  year  of  the  plan,  the  leadership 


Linda  Arlidge,  Nancy  Broad, 
Charlie  Craig,  Vidyajaisaree, 
Janet  Lewis,  and  Beate  Blanche 


team  will  share  their  learning  and  school-level 
experience  with  other  schools  across  the  board 
as  they  begin  a similar  process. 

System  Awareness 

In  an  effort  to  highlight  some  of  the  assess- 
ment issues  and  challenges  we  face,  and  in 
order  to  begin  to  share  our  plans  related  to 
developing  a culture  of  assessment,  we  con- 
ducted a two-day  Summer  Institute  entitled 
Assessment  and  Evaluation:  Putting  the  Pieces 
Together.  The  institute  opened  with  a dynamic 
keynote  presentation  by  Dr.  Tom  Guskey  who 
challenged  us  to  use  assessment  to  promote 
student  learning.  The  institute,  offering  over 
60  workshops,  was  well  attended  and  received 
by  all  participants.  After  staff  returned  to 
their  schools  in  September,  teachers  and 
administrators  were  still  talking  about  and 
requesting  readings  and  resource  materials 
related  to  the  topic  of  assessment. 

The  Leadership  Team: 

A Progress  Report 

Members  of  the  leadership  team  met  for  the 
first  time  in  May  1 999,  and  since  then  have  met 
every  two  weeks  for  a half-day.  Our  first  goal 
was  for  each  of  us  to  develop  a high  level  of 
assessment  literacy,  and  to  that  end,  we  spent 
an  enormous  amount  of  time  reading  every- 
thing we  could  find  related  to  assessment. 
Names  like  Stiggins,  Wiggins,  McTighe, 
Guskey,  O’Connor,  and  Earl  and  Cousins 
became  commonplace  in  our  vocabulary. 
We  were  fortunate  to  have  had  the  support  of 
the  board  and  were  able  to  send  almost  all  of 
the  members  of  our  team  to  the  Assessment 
Training  Institute  Conference  in  Portland 
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Oregon. T lie  Chairman  of  the  lioarcl  attended 
the  conference  with  us  and  is  a regular  partici- 
pant in  our  bi-weekly  meetings. 

School  Learning  Teams; 

One  Goal,  Many  Pathways 

As  part  of  the  ATP,  each  administrator  and 
teacher  on  the  leadership  team  was  to  establish 
an  assessment  learning  team  in  their  school. 
The  teams  were  to  consist  ot  tour  to  eight  vol- 
unteers who  were  interested  in  increasing 
their  levels  of  assessment  literacy,  questioning 
their  assessment  practices  and  trying  new 
materials  and  methods  in  their  classrooms. 
Once  established,  these  teams  conducted  self- 
assessments,  established  operating  norms  and 
a meeting  schedule  based  on  their  needs  and 
goals.  Once  in  operation,  these  school  teams 
regularly  made  decisions  regarding  when  and 
how  to  involve  the  whole  staff  in  their  journey. 

As  we  move  forward  with  our  school  level 
assessment  learning  teams,  we  are  finding  that 
there  is  onlv  one  constant  in  this  process,  and 
that  is  our  overall  goal.  The  structure  and 
process  vary  as  much  in  each  school  as  docs  the 
membership  on  each  of  the  teams.  For  exam- 
])le,  at  one  school  we  ha\  e a team  consisting 
mainly  of  department  heads,  while  at  another 
school  there  is  greater  rejiresentation  of  teach- 
ers from  one  particular  division  and  in  a third 
school  the  team  includes  parents  who  regularly 
attend  the  meetings  and  learn  along  with  the 
stall  members  on  the  team. 

The  Leadership  Team: 

Some  Personal  Reflections 

Personal  rellection  is  an  ongoing  component 
of  the  learning  team  process.  Participants  on 
the  leadership  team  regularly  rellect  on  their 
experiences  and  personal  learning.  One 
administrator  commented: 


“The  o|iportunitv  to  rellect  on  our  assess- 
ment and  evaluation  practices  has  been  stimu- 


GUIDING  PRINCIPLES 

1 .The  primary  purpose  of  as.sessment  is  to 
improve  student  learning. 

2.  Assessment  practices  are  fair  and  equi- 
table for  all  students. 

3.  Communication  about  assessment  is  on- 
going, clear  and  meaningful. 

4.  Professional  development  and  collabora- 
tion support  assessment. 

5 . Partners  in  education  are  involved  in  the 
assessment  process. 

6.  Assessment  practices  are  regularly 
reviewed  and  refined. 


STANDARD  DF  HIGH  QUALITY 
ASSESSMENT— EDUCATDRS: 

1 . align  assessment  with  the  expectations 
outlined  in  the  Ontario  Curriculum; 

2 . use  methods  that  arc  appropriate  to  the 
achievement  targets; 

3.  provide  students  with  multi|)le  and 
varied  ojjportunities  to  demonstrate 
achievement; 

4.  control  for  all  relevant  sources  of  bias 
and  distortion  that  can  lead  to  inaccu- 
rate assessment; 

5.  collect  sufficient  information  to  make 
informed  decisions;  and 

6.  use  results  to  make  decisions  about 
program  and  instruction. 


Excerpts  Irom  Curriculum  Expectations  for  York  Region  Schools,  A Curriculum  Framework  1 999. 


lating,  humbling  and  energizing.  We  have  so 
much  to  learn  about  the  |iotential  of  assess- 
ment as  a learning  tool... Some  of  my  own 
instincts  about  the  process  ol  gathering  and 
using  data  to  guide  teaching  and  learning  were 
headed  in  the  right  tlirection.  But  I also  real- 
ized that  as  a teacher  I had  not  involved  my  stu- 
dents enough  in  the  process  of  self-evaluation, 
in  the  practice  phase  of  learning,  in  opportuni- 
ties to  relearn,  and  I doubt  that  1 always  set 
clear  targets  for  my  students  to  reach.” 

A principal  commented: 

“Hearing  Tom  Guskey  speak  and  reading 
K.cn  O’Connor  came  at  the  perfect  time  for 
me... they  provided  me  with  signposts  to 
guide  my  in<;|uiries.  I set  aside  my  personal  and 
professional  beliefs  and  biases  and  read  the  the- 
ory. I attended  the  worksho|3s  with  an  open 
mind  and  gratlually  began  to  link  my  new 
learning  about  assessment  and  evaluation  with 
my  former  beliefs.  What  1 have  come  to  under- 
stand and  articulate  is  that  there  are  better 
strategies  to  use  so  that  all  students  remain 
connected  with  their  learning. . .so  that  all  stu- 
dents can  succeed  in  school.” 

One  teacher  noted: 

“I  realized  through  mv  readings  that  1 knew 
some  aspects  of  projjcr  assessment,  but  still 
had  a long  \\  a\-  to  go.  1 guess  you  could  say  that 
1 now  know  what  I do  not  know!  I realize  that 
this  w ill  be  a process  that  will  continue  bevond 
my  work  on  this  team,  but  I know  1 will  contin- 


ue to  read,  research  and  apply  the  assessment 
principles  I am  learning.” 

The  School  Experience: 

The  Reality  and  the  Challenge 

As  members  of  the  leadership  team  continue 
to  work  w’ith  their  respective  school  learning 
teams  and  staff  members  they  are  faced  with  a 
variety  of  challenges. 

One  teacher  member  of  the  leadership  team 
commented  on  her  experiences  as  part  of  the 
school  learning  team: 

“The  greatest  challenge  is  to  swdtch  to  the 
new  paradigm . . . We  are  learning  together  how- 
to create  rubrics  with  our  students  and  create 
sound  [lerformance  assessments  for  our  class- 
rooms. It  will  require  years  of  training  tor 
teachers  to  become  assessment  literate  and 
api^b'  the  principles  of  assessment  in  the  class- 
room, but  we  are  on  our  way.” 

Rcllcctiiig  on  her  experiences  in  this  learn- 
ing process,  one  administrator  noted: 

“Working  on  the  school  learning  team  at  the 
school  level  has  raised  the  level  ot  dialogue — 
from  teachers  justifying  what  they  are  doing  to 
explaining  w hat  thev  are  tloing  in  the  area  of 
assessment.  I he  team  has  raised  the  awareness 
of  the  need  to  re-examine  and  challenge  many 
of  the  assumptions  that  we  have  made  about 
the  assessment-instruction  link. The  mere  idea 
that  we  are  able  to  shift  the  focus  from  'I  taught 
it  but  thev  didn’t  learn  it’  to'i  low  can  I teach  it 
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“We  began  our  journey  by  articulating  a vision  for  effective  assessment  practices  in  our  schools. . 

the  Leadership  Team 


to  them  so  that  they  get  it?’  has  been  a huge 
paradigm  shift.” 

Reflecting  further,  the  same  administrator 
noted:  “ft  is  important  to  begin  with  what 
teachers  are  already  doing  and  encourage 
thoughtful  reflection  on  their  practices.  This  is 
what  takes  time,  but  to  do  otherwise  would 
risk  teachers  viewing  it  as  just  another  fad  that 
will  pass.” 

Another  administrator  also  commented  on 
the  rate  of  progress  at  the  school  level: 

“The  process  of  supporting  a school  learning 
team,  while  very  purposeful  and  satisfying,  is 
one  that  is  evolving  more  slowly  than  I first 
envisioned.  My  teacher  partner  and  I are 
enthusiastic  about  our  task  and  want  to  share 
and  learn  with  our  teachers;  however,  the  real- 
ity of  finding  quality  time  together  is  a chal- 
lenge. Supporting  a school  learning  team  is 
best  seen  as  a long-term  project  and  process.” 

Linking  Assessment  and  School  Planning 

While  developing  assessment  literacy  is  a wor- 
thy goal,  it  is  of  little  value  if  disconnected 
from  the  school  planning  process.  One  admin- 
istrator commented  on  the  connection 
between  assessment  and  her  school  plan: 

“At  our  school,  we  already  have  a school 
plan  in  place  which  focuses  on  continually 
improving  student  learning.  In  order  to  ensure 
that  what  I am  asking  of  teachers  is  both  man- 
ageable and  practical,  1 have  aligned  all  of  our 
work  related  to  classroom  assessment  and  pro- 
fessional development  with  the  school  plan- 
ning process.  At  the  beginning  of  the  year, 
teachers  used  diagnostic  assessments  to  obtain 
baseline  data,  and  professional  development  at 
that  time  focused  on  the  diagnostic  and  analysis 
processes.” 

She  continued  to  say: 

“School-level  professional  development  for 
all  teachers  occurs  at  monthly  meetings,  with 
the  exception  that  teachers  rethink  some  of 
their  practices  and  ex[3lore  different  ways  to 
assess  learning  as  part  of  their  day-to-day 
teaching.  At  the  same  time,  members  of  the 
school  assessment  learning  team  are  examin- 
ing other  pieces  of  the  assessment  puzzle 
through  personal  study  and  regular  meetings. 
They  are  also  working  in  small  groups  to  devel- 
oj)  assessment  tools  for  all  staff  to  assess  stu- 
dent performance  of  the  short-term  goals 
identified  in  our  school  plan.” 


Initiatives  from  the  Field 

We  have  found,  over  the  past  few  months,  a 
growing  interest  in  learning  about  assessment 
and  as  a result  the  following  assessment  activi- 
ties have  been  initiated  in  “the  field.”  Firstly,  a 
principal  professional  development  planning 
committee  consisting  of  elementary  school 
administrators  identified  assessment  as  their 
professional  development  focus  for  the  year. 

Three  professional  development  sessions 
focusing  on  classroom  assessment  were  devel- 
oped and,  although  school  members  of  our 
leadership  team  had  not  anticipated  being 
involved  in  providing  regional  professional 
development  until  next  year,  they  met  with 
rave  reviews  as  they  shared  their  experiences 
with  administrators  at  a session  in  January 
2000. 

A second  development  was  the  creation  of  an 
assessment  study  group  consisting  of  elemen- 
tary school  administrators. This  grass  roots  ini- 
tiative facilitated  by  an  administrator  has 
resulted  in  biweekly  meetings  that  have  focused 
on  assessment.  As  word  of  this  initiative  has 
spread  throughout  the  system,  three  more 
assessment  study  groups  for  administrators  have 
been  created. 

Summary 

As  we  move  towards  building  a culture  of 
assessment  inYork  Region  we  realize  that  our 
work  has  just  begun.  Although  we  have  moved 
more  quickly  than  anticipated  in  the  area  of 
administrator  aw'areness  and  commitment,  in 
other  areas  we  are  moving  more  slowly. 


The  experiences  of  the  leadership  team, 
over  the  past  eight  months,  have  allowed  mem- 
bers to  experience  the  learning  team  process 
themselves.  It  has  also  provided  them  with  an 
opportunity  to  conduct  an  ongoing  evaluation 
of  the  professional  development  that  is  occur- 
ring at  the  school  level  in  order  to  discern  its 
impact.  Reflecting  on  these  experiences,  we 
are  confident  that  the  learning  team  approach 
to  professional  growth  is  taking  us  in  the  right 
direction. 

Learning  teams  inYork  Region  are  here  to 
stay.  In  the  words  of  one  administrator: 

“We  value  w'hat  our  teachers  have  been  doing 
in  the  area  of  assessment.  We  emphasize  that  we 
arc  learning  and  working  together  to  build  a cul- 
ture of  assessment,  and  we  need  to  do  this  w'ell. 
While  it  may  take  us  some  time  to  get  there,  we 
are  confident  that  we  can  do  it!”  Q 
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Susan  Orchard 


Supporting  Effective 
Classroom  Assessment  and 
Evaluation  Practices 


Assessment  and  evaluation  practices  are 
undergoing  rapid  change  in  Ontario. 
Teachers  often  have  questions  about 
I the  educational  rationale  for  the 
changes  and  about  what  effective  assessment 
and  evaluation  looks  like  in  the  classroom, 
d hey  need  ongoing  professional  development 
op|3ortunities  to  learn,  practice  and  share  their 
knowledge  and  skills. 

With  a reduction  in  school  district  staff 
development  resources,  providing  ongoing 
professional  development  opportunities  has 
become  the  challenge  of  formal  and  informal 
school  leaders.  They  arc  creating  schoobbased 
staff  learning  programs  to  help  teachers  devel- 
op the  knowledge  and  skills  necessarv  to  main- 
tain and  improve  the  quality  of  the  teaching 
and  learning. 

These  realities  pose  implementation  chal- 
lenges for  schools  and  boards.  What  needs  to 
be  in  jrlace  to  ensure  a consistent,  aligned  and 
equitable  approach  from  school  to  school? 

The  Halton  District  .School  Board  has 
dc\  clo|)ed  Guidelines  for  Assessment  and  Evalua- 
tion of  Student  Achievement . The  guidelines, 
based  on  Ministry  ot  Education  assessment 
and  e\aluation  policy,  focus  on  the  im|-)rovc- 
ment  of  student  learning.  Thev  pro\idc  a 
iramework  to  help  ensure  that  assessment  and 
e\aluation  practices  are  fair,  consistent,  and 
used  appropriately  in  all  schools  in  Halton. 

1 hev  can  be  used  at  the  school  level  to  assist 
teachers  in  professional  learning  and  planning 
for  growth. 

1 he  Guidelines  contain  a set  of  twentv 
Principles,  w hich  address  the  most  important 


The  self-assessment  tool  reinforces  the 

concept  that“implementation  is  a 

process  and  not  an  event.” 

issues  involving  assessment  and  evaluation  in 
our  elementary  and  secondary  schools.  Each 
Principle  includes: 

Key  -These  explain  the  “must 

do’s”  and  the  details  related  to  each  principle. 
They  provide  direction  about  routines  to  be 
followed. 

Burning  Qiiestions — These  raise  the  difficult 
issues  related  to  each  Princi|:)lc.  They  may 
address  teacher,  student,  parent  or  administra- 
tive issues. 

Effective  Practice — Accomj^anving  each  Princi- 
ple are  examples  of  what  you  might  sec  in  a 
classroom  where  the  Principle  is  being  fully 
implemented. The  examples  describe  both  ele- 
mentary and  secondary  situations. 

In  addition  to  the  Principles,  the  document 
provides  teachers  with  an  Assessment  and 
E\aluation  Self-Assessment  and  a template  to 
develop  a Plan  for  Professional  Growth. The 
self-assessment  tool  was  develojred  to  provide 
teachers  \\  ith  a clear  picture  of  w hat  thev  need 
to  know  and  be  able  to  do  as  thev  implement 
the  assessment  exaluation  jaolicy  and  related 
classroom  practices,  ft  is  an  implementation 


profile  with  criteria  and  performance  indica- 
tors.The  criteria  have  been  set  ujx  as  questions. 
Teachers  reflect  on  the  questions  and  deter- 
mine the  extent  to  which  they  have  imple- 
mented the  criteria  by  examining  the  related 
performance  descri|ators  under  each  imple- 
mentation stage. 

The  self-assessment  tool  reinforces  the  con- 
cept that  “implementation  is  a process  and  not 
an  event.”The  profile  is  provided  for  teachers 
to  gauge  their  progress  towards  best  practice 
in  assessment  and  evaluation  and  help  them 
plan  future  professional  growth. 

NOTE 

The  rubric  for  Halton’s  Guidelines  for  Assessment 
and  Evaluation  of  Student  Acievement  is  repro- 
duced on  pages  30-31.  It  was  written  by: 
Damian  Cooper,  Jeff  Catania,  Keith  Clark, 
Ruth  Dawson,  I leather  Gatavcckas,  Mary 
Marshall,  Eibby  Stephenson  and  Nanci 
Wakeman-Joncs. 
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Standards  and  Principles 


MAKING  THE  SHIFT  IN  ASSESSMENT  AND  EVALUATION 
WHAT  IS  HAPPENING  IN  YOUR  SCHOOL? 

Criteria  Phases 

A ^ 

Awareness 

Preparation 

Practice 

Mastery 

Integration 

Are  my 

assessment  and 
evaluation 
practices  tied  to 
the  provincial 
curriculum? 

aware  of  provincial 
curriculum  document, 
but  not  familiar  with  it 
'»  assessment  practices 
may  or  may  not 
match  curriculum 
expectations 
provincial  achieve- 
ment levels  are  not 
the  reference  point  for 
evaluation 

have  read  the 
document 

'»  beginning  to  develop 
assessment  practices 
that  match  the  cur- 
riculum expectations 

''i  provincial  achieve- 
ment levels  are  begin- 
ning to  be  used  as 
reference  points  for 
evaluation 

know  the  document 
well 

most  assessment 
practices  match 
the  curriculum 
expectations 
provincial  achieve- 
ment levels  are 
regularly  used  as 
reference  points  for 
evaluation 

V very  familiar  with  doc- 
ument, know  it  cold 

V reflect  on  and  refine 
assessment  practices 
to  match  curriculum 
expectations 

the  most  consistent 
provincial  achieve- 
ment level  demon- 
strated by  a student  is 
recorded 

Do  1 communicate 
assessment 
criteria  and  feed- 
back effectively? 

no  written  criteria, 
vague  criteria  or 
criteria  not  known  to 
students  until  work 
is  marked 
feedback  is  given 
upon  the  completion 
of  work 

no  opportunity  for 
student  improvement 

have  specific  written 
criteria  for  work,  but 
it  is  not  shared  with 
students  at  the 
outset 

''i  feedback  is  irregular, 
or  only  at  grading 
times 

'» limited  opportunity  for 
student  improvement 

specific  criteria  is 
shared  with  students 
before  work  is  started 
(i.e.,  they  know  the 
targets) 

feedback  is  given 
regularly  before  work 
is  completed 
good  opportunity  for 
student  learning 

students  have  some 
opportunity  to  provide 
input  into  assessment 
criteria 

feedback  is  frequent 
in  formal  and  informal 
modes 

best  opportunity  for 
student  learning 

Do  1 use  a balanced 
variety  of  assess- 
ment methods, 
tools  and 
strategies? 

'*  unaware  of  different 
forms  of  assessment 
'»  most  or  all  assess- 
ment is  done  at  the 
end  of  the  learning 
(summative) 
only  grade  the 
pro-ducts  of  student 
work 

know  a variety  of 
methods,  but  use 
mostly  one  (i.e.,  paper 
& pencil) 

assessment  opportu- 
nities with  feedback 
are  given  during  the 
learning  phase  as 
well,  (formative) 
grade  product,  and 
provide  only  informal 
oral  feedback  on 
process  as  students 
work 

use  all  methods 
(paper  & pencil, 
performance  and 
personal  communica- 
tion) but  in  an 
unbalanced  way 
'»  some  assessment  is 
also  done  to  help  plan 
teaching  (diagnostic) 
assess  and  evaluate 
both  the  product  and 
process  of  student 
work 

assessment  methods 
and  tools  fit  naturally 
with  what  is  being 
assessed 

''k  emphasize  diagnostic, 
formative  or  summa- 
tive assessment 
depending  on  which 
is  appropriate 
process  and  product 
assessed  using  best 
tool  and  balance 
between  the  two 
depends  on  student 
age  and  curriculum 
expectations 

Do  1 separate 
learning  skills 
from  student 
achievement? 

unaware  of  what  the 
learning  skills  are  or 
evidence  is  not 
gathered  for  learning 
skills 

V learning  skills  are 
assessed  only  infor- 
mally and  graded 
purely  subjectively 
(i.e.,  little  evidence 
gathered  if  any) 
learning  skills  “types” 
of  marks  are  factored 
into  achievement 
grades  (i.e.,  home- 
work completion) 

evidence  of  learning 
skills  is  collected 
using  appropriate 
tools 

achievement  grades 
reflect  purely  achieve- 
ment and  learning 
skills  grades  are 
based  on  clear 
evidence 

'»  students’  learning 
skills  are  assessed  in 
a variety  of  ways,  at 
multiple  times,  based 
on  the  most  consistent 
level  reached  and 
reported  separately 
from  achievement 
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Criteria  Phases 

Awareness 

Preparation 

Practice 

Mastery 

Integration 

Do  1 promote  (not 
discourage) 
learning  by  using 
assessment  and 
evaluation 
practices  that: 

are  not  unexpected  surprises 

allow  students  to  demonstrate  and  celebrate  their  learning 
provide  specific,  timely  feedback  telling  students  how  to  improve 
'»  engage  and  motivate  students  by  relating  to  the  real  world  and  being  as  fun  as  possible 
do  not  involve  prior  conceptions  of  students’  abilities 
use  late  penalties  fairly  and  consistently  when  appropriate 
consider  a student’s  most  consistent  achievement  (i.e.,  not  factoring  in  “zeroes”) 

'»  weight  grades  according  to  the  proportion  of  the  curriculum  documents  they  represent,  not  the 
denominator  of  the  mark 
V treat  cooperative  group  situations  with  care 

few  of  the  above 
apply  to  my  practice 
(0-2  checks) 

some  of  the  above 
apply  to  my  practice 
(3-4  checks) 

most  of  the  above 
apply  to  my  practice 
(5-7  checks) 

'»  all  or  almost  all  of  the 
above  apply  to  my 
practice  (8-9  checks) 

Are  my  grading 
practices  based  on 
sufficient  evidence 
of  achievement? 

grades  are  based  on 
one  opportunity  which 
students  had  to 
demonstrate  learning 
for  each  given 
expectation 

grades  are  based  on 
multiple  opportunities 
to  demonstrate  learn- 
ing which  are  all  aver- 
aged together, 
including  diagnostic 
“first  tries” 

grades  are  based  on 
multiple  opportunities 
to  demonstrate  learn- 
ing in  a variety  of  con- 
texts, without  counting 
first  tries  or  the  odd 
missed  assessment 

'»  grades  are  based  on 
the  most  consistent 
demonstration  of 
learning  a student  has 
shown,  with  some 
assessments  that 
group  expectations  to 
provide  evidence  in 
multiple  areas 

1 Do  1 involve  the 
1 students 
1 (and  others)  in  my 
assessment  and 
evaluation 
practice? 

'» the  teacher  is  the 
sole  assessor  and 
evaluator 
students  are  not 
involved  in  the  deter- 
mination of  criteria  of 
the  comparison  of 
achievement  to  the 
criteria 

'»  students’ self  and 
peer  assessments 
about  their  own  learn- 
ing are  considered  to 
help  corroborate  the 
teacher’s  assessment 

students  learn  about 
objectivity,  discretion, 
accuracy,  consisten- 
cy, etc;  to  improve  self 
and  peer  assessment 
appropriate  tools 
are  provided  to 
facilitate  self  and 
peer  assessment 

'»  a balance  of  self, 
peer  and/or  teacher 
assessments  are  used 
when  appropriate 
students  help  develop 
tools  and  criteria 
V parents  or  subject 
experts  have  opportu- 
nities to  provide  stu- 
dents with  feedback 

Do  1 modify  my 
assessment  and 
evaluation  prac- 
tices appropriately 
for  students  with 
special  needs? 

aware  of  the  ways 
assessment  is  modi- 
fied: by  tool  (e.g.  oral 
test  instead  of  writ- 
ten), breadth,  depth, 
time,  etc. 

'»  beginning  to  modify 
assessments  based 
on  students’  needs 

modifying  assess- 
ments based  on 
students’  needs  using 
a range  of  modifica- 
tions 

'» routinely  modify 
assessments  appro- 
priately for  a wide 
variety  of  needs 
and  employ  student 
records  and  support 
staff  to  help 

Are  my  assess- 
ment and  evalua- 
tion practices 
sensitive? 

in  planning  and 
reflecting  on  my  prac- 
tice, 1 would  rarely 
consider  racial, 
social,  financial,  cul- 
tural, religious,  gen- 
der or  confidentiality 
issues  that  may  affect 
student  learning 

in  planning  and 
reflecting  on  my  prac- 
tice, 1 sometimes  con- 
sider racial,  social, 
financial,  cultural,  reli- 
gious, gender  or  con- 
fidentiality issues  that 
may  affect  student 
learning 

'*  in  planning  and 
reflecting  on  my  prac- 
tice, 1 often  consider 
racial,  social,  finan- 
cial, cultural,  religious, 
gender  or  confidential- 
ity issues  that  may 
affect  student  learning 

in  planning  and 
reflecting  on  my 
practice,  1 consistently 
consider  racial,  social, 
financial,  cultural, 
religious,  gender  or 
confidentiality  issues 
that  may  affect 
student  learning 
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Self-Evaluation — 
What  Do  We  Know? 


Carol  Rolheiser  and  John  Ross 


Tl  caclicrs  today  are  experimenting  with 
alternatives  to  traditional  tests.  Perfor- 
mance assessment,  portfolio  collections, 
classroom  observation,  peer  assessment, 
and  self-evaluation  are  joining  the  unit  test  and 
the  final  exam  in  the  rejjertoire  of  the  skillful 
teacher.  Such  teachers  ensure  that  an  over- 
reliance on  testing  does  not  seriously  distort 
instruction  or  impede  important  school 
improvement  eflorts.  Accordingly,  their  pro- 
grams are  based  on  a range  of  assessment 
aj:)proaches,  including  authentic  assessment. 
Teachers  who  include  authentic  assessment  in 
their  repertoires  are  driven  hy  a belief  that  cur- 
riculum-assessment experiences  should  pre- 
pare students  for  life  in  the  real  w'orld. 

While  teacher-made  tests  and  standardized 
tests  give  us  information  about  student  learn- 
ing, they  do  not  provide  all  the  information. 
Alternative  forms  of  assessment  can  generate 
that  other  information.  Shulman’s  term  “a 
union  of  insufficiencies”  is  a very  compelling 
notion  in  thinking  about  the  relationship 
between  tests  and  other  forms  of  assessment. 
Various  methods  of  assessment  need  to  work 
together  so  that  the  “strengths  of  one  offset  the 
limitations  of  the  others”  (Skylight,  2000,  p. 
23).  No  single  method  or  tool  can  provide  all 
the  information  needed  to  create  a multi- 
dimensional portrait  of  the  student  as  a learner 
(Skylight,  2000).  Indeed,  methods  need  to  be 
combined  to  com|)lement  each  other. 

For  the  last  seven  years,  we  have  been  work- 
ing with  teachers  at  all  grade  levels  to  develop 
alternative  forms  of  authentic  student  assess- 
ment strategics. The  research  evidence  accu- 
mulating in  our  studies,  and  the  data  produced 
by  other  researchers,  make  us  optimistic  about 


the  impact  of  one  form  of  authentic  assess- 
ment— self-evaluation — on  the  learning  of 
students  and  their  teachers. 

Self-evaluation  is  defined  as  students  judging 
the  quality  of  their  work,  based  on  evidence 
and  explicit  criteria,  for  the  purpose  of  doing 
better  work  in  the  future.  When  we  teach  stu- 
dents how  to  assess  their  own  progress,  and 
when  they  do  so  against  known  and  challeng- 
ing quality  standards,  we  find  that  there  is  a lot 
to  gain.  Self-evaluation  is  a potentially  power- 
ful technique  because  of  its  impact  on  student 
performance  through  enhanced  self-efficacy 
and  increased  intrinsic  motivation.  Evidence 
about  the  positive  effect  of  self-evaluation  on 
student  performance  is  particularly  convincing 
for  difficult  tasks,  especially  in  academically 
oriented  schools,  and  among  high-need  pupils. 
Perhaps  just  as  important,  students  like  to  eval- 
uate their  work. 

A Four-Stage  Model  for  Teaching 
Student  Self-Evaluation 

In  one  stage  of  our  research  we  interviewed 
exemplary  users  of  co-operative  learning 
methods  (Ross,  et  ah,  1998).  When  individual 
insights  were  assembled  in  a composite  pic- 
ture, a generic  four-stage  procedure  emerged 
for  teaching  students  their  role  in  self-evalua- 
tion. 

Stage  I — Involve  students  in  defining  the  crite- 
ria that  will  be  used  to  judge  their  perfor- 
mance. Involving  students  in  determining  the 
evaluation  criteria  initiates  a negotiation.  Nei- 
ther imposing  school  goals  nor  acquiescing  to 
student  preferences  is  likely  to  be  as  successful 
as  creating  a shared  set  that  students  perceive 


SelJ-evaluation  is  a potentially 
powerful  technique  because  oj its 
impact  on  student  performance 
through  enhanced  self-efficacy  and 
increased  intrinsic  motivation. 


to  be  meaningful.  Workplace  studies,  for 
example,  indicate  that  involving  employees  in 
making  decisions  about  their  work  increases 
satisfaction  and  goal  commitment.  In  addition 
to  increasing  student  commitment  to  instruc- 
tional goals,  negotiating  intentions  enables 
teachers  to  help  students  set  goals  that  are  spe- 
cific, immediate,  and  moderately  difficult 
characteristics  that  contribute  to  greater 
effort.  The  specific  steps  to  guide  this  stage  are 
as  follows: 

^ students  brainstorm  criteria 
^ teacher  and  students  negotiate  criteria 
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^ use  student  language  to  co-develop  stan- 
dards (e.g. , a rubric) 

Stage  2 — Teach  students  how  to  apply  the 
criteria  to  their  own  work.  If  students  have 
been  involved  in  a negotiation  in  Stage  1 , the 
criteria  that  result  will  be  an  integrated  set  of 
personal  and  school  goals.  Since  the  goals  are 
not  entirely  their  own,  students  need  to  see 
examples  of  what  they  mean  in  practice.  These 
models  or  examples  help  students  understand 
specifically  what  the  criteria  mean  to  them. 
Teacher  modeling  is  very  important,  as  is  pro- 
viding numerous  examples  of  what  particular 
categories  mean,  using  language  that  connects 
criteria  to  evidence  in  the  appraisal. The  specif- 
ic steps  to  guide  this  stage  are  as  follows: 

show  examples 

students  practice  classifying  the  examples 

using  the  criteria  and  standards  generated 

Stage  3 — Give  students  feedback  on  their  self- 
evaluations.  Students’  initial  comprehension  of 
the  criteria  and  how  to  apply  them  are  likely  to 
be  imperfect. Teachers  need  to  help  students 
recalibrate  their  understanding  by  arranging 
for  students  to  receive  feedback  (from  the 


teacher,  peers,  and  themselves)  on  their 
attempts  to  implement  the  criteria.  Having 
different  sources  (e.g.,  peers  and  teacher)  pro- 
vide data  for  comparison  helps  students  devel- 
op accurate  self-evaluations.  Discussion 
regarding  differences  in  data  can  prove  most 
helpful. The  specific  steps  to  guide  this  stage 
are  as  follows: 

^ provide  comparative  data 

talk  about  similarities  and  differences 

Stage  4 — Help  students  develop  productive 
goals  and  action  plans.  The  most  difficult  part  of 
teaching  students  how  to  evaluate  their  work 
consists  of  designing  ways  to  provide  support 
for  students  as  they  use  self-evaluative  data  to 
set  new  goals  and  levels  of  effort.  Without 
teacher  help,  students  may  be  uncertain 
whether  they  have  attained  their  goals.  Teach- 
ers can  also  help  students  connect  particular 
levels  of  achievement  to  the  learning  strategies 
they  adopted  and  the  effort  they  expended. 
Finally,  teachers  can  help  students  develop 
viable  action  plans  in  which  feasible  goals  are 
operationalized  as  a set  of  specific  action  inten- 
tions. The  specific  steps  to  guide  this  stage  are 
as  follows: 


students  identify  strengths/ weaknesses 
based  on  comparative  data 
^ students  generate  goals 
^ teacher  guides  students  to  develop  specific 
actions  toward  their  goals 
students’  goals  and  action  plans  are  recorded 

Frequently  Asked  Questions  About  Self-Evaluation 

Do  students  who  are  taught  how  to  evaluate 
their  work  learn  better  or  more  poorly  than 
other  students? 

Three  kinds  of  student  benefits  have  been 
observed  in  the  studies  we  and  other 
researchers  have  conducted. The  first  is  cogni- 
tive achievement,  especially  narrative  writing 
skills  (Ross  et  al. , 2000).  Students  become  bet- 
ter writers  by  learning  how  to  evaluate  their 
prose. The  effects  are  strongest  for  the  weakest 
writers.  Self-evaluation  training  helps  the  low 
group  the  most  because  they  are  less  certain 
about  what  constitutes  good  writing.  All  stu- 
dents, however,  seem  to  benefit  from  the 
focusing  effect  of  joint  criteria  development 
and  use.  The  second  benefit  is  in  the  area  of 
motivation.  Students  who  are  taught  self-eval- 
uation skills  are  more  likely  to  persist  on  diffi- 
cult tasks,  be  more  confident  about  their 
ability,  and  take  greater  responsibility  for  their 
work. Third,  students’  attitudes  toward  evalua- 
tion become  more  positive  when  they  partici- 
pate in  the  process.  As  students  grow  older 
they  become  increasingly  cynical  about  tradi- 
tional testing.  When  self-evaluation  is  included 
as  a contributor  to  their  final  grade,  students 
are  more  likely  to  report  that  evaluation  is  fair 
and  worthwhile.  Clearly,  there  is  heightened 
meaningfulness  of  self-evaluation  over  other 
assessment  data. 

Do  students  self-evaluate fairly? 

Many  teachers,  parents,  and  students  believe 
that  if  students  have  a chance  to  mark  their 
own  work  they  will  take  advantage,  giving 
themselves  higher  scores  regardless  of  the 
quality  of  their  performance.  We  have  found 
that  students,  especially  older  ones,  may  do 
this  if  left  to  their  own  devices.  But,  when  stu- 
dents are  taught  systematic  self-evaluation  pro- 
cedures, the  accuracy  of  their  judgment 
improves.  Contrary  to  the  beliefs  of  many  stu- 
dents, parents,  and  teachers,  students’  propen- 
sity to  inllate  grades  decreases  when  teachers 
share  assessment  responsibility  and  control 
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( Ross,  et  al . , 2000) . When  students  participate 
in  the  identification  of  the  criteria  that  will  he 
used  to  judge  classroom  production  and  use 
these  criteria  to  judge  their  work,  they  get  a 
better  understanding  of  what  is  expected.  The 
result  is  the  gap  between  their  judgments  and 
the  teachers’  judgment  is  reduced.  And,  by 
focusing  on  evidence,  discrepancies  between 
teacher  and  self-evaluation  can  be  negotiated 
in  a productive  way. 

What  kinds  of  selj-evaluation  techniques 
have  the  greatest  chance  of  increasing  stu- 
dent achievement  and  accuracy  of  self- 
appraisal? 

■fhoughtfullv  designed  self-evaluation  proce- 
dures that  provide  students  with  explicit  crite- 
ria at  an  appropriate  level  of  generality,  that 
j)rovide  lor  student  involvement  in  assessment 
decision-making,  that  elicit  student  cognitions 
about  their  performance,  that  ground  student 
goal  setting  in  accurate  data,  and  that  are  inte- 
grated with  sensitive  instruction  may  provide 
teachers  with  a powerful  lever  for  enhancing 
student  learning. 

What  research  or  theory-based  argument 
best  connects  student  self-evaluation  to 
achievement  gains? 

We  base  our  expectations  that  a self-evaluation 
assessment  system  enhances  student  achieve- 
ment on  four  arguments.  Students  will  learn 
more  because  (1)  self-evaluation  will  focus 
student  attention  on  the  objectives  measured, 
(2)  the  assessment  jjrovides  teachers  with 
information  they  would  otherwise  lack,  (3) 
students  will  pay  more  attention  to  the  assess- 
ment, and  (4)  student  motivation  will  be 
enhanced. 

fhese  four  arguments  are  substantiated  by 
our  own  research,  and  that  of  others.  For 
example,  it  has  long  been  demonstrated  that 
being  clear  about  goals  makes  a positive  contri- 
bution to  performance.  .Self-evaluation  helps 
locus  students’  attention  on  the  objectives 
being  measured. 

.■\s  well,  sell-evaluation  is  unique  in  asking 
students  t(i  rellcct  on  their  jjerformance.  Con- 
ventional tost  procedures  j^rovide  no  informa- 
tion about  students’  inner  states  during  task 
jrerformance,  their  subsequent  interpretations 
about  the  cpialitv  of  their  w ork,  and  the  goals 
they  set  in  res|ionse  to  feedback.  Self-evalua- 


tions that  elicit  information  about  students’ 
effort,  persistence,  goal  orientations,  attribu- 
tions for  success  and  failure,  and  beliefs  about 
their  competence,  give  teachers  a fuller  under- 
standing of  why  students  perform  as  they  do. 
When  incorporated  into  teachers’  deliberative 
planning  they  can  anticipate  impediments  to 
learning,  e.specially  motivational  obstacles. 

As  students  move  through  the  school  system 
their  skepticism  about  the  \alidity  of  test 
scores  increases.  Students  view  self-evaluation 
more  positively  than  other  kinds  of  assess- 
ment. We  found  that  students  like  self-evalua- 
tion because  it  increased  clarity  about 
expectations,  was  fairer,  and  gave  students 
feedback  that  they  could  use  to  improve  the 
quality  of  their  work  ( Ross  et  al. , 1 998b). 

Finally,  self-evaluation  has  an  indirect  effect 
on  achievement  through  self-efficacy  (i.e., 
beliefs  about  one’s  ability  to  perform  actions 
that  lead  to  desired  ends).  What  is  crucial  is 
how  a student  evaluated  a performance.  Posi- 
tive self-evaluations  encourage  students  to  set 
higher  goals  anti  commit  more  personal 
resources  to  learning  tasks.  Negative  self-eval- 
uations lead  students  to  embrace  goal  orienta- 
tions that  conflict  with  learning,  select 
personal  goals  that  are  unrealistic,  adopt  learn- 
ing strategies  which  are  ineffective,  exert  low- 
effort  and  make  excuses  for  performance. 
Higher  self-efficacy  translates  into  higher 
achievement. 

These  four  arguments  suggest  that  self-eval- 
uation is  a potential h'  powerful  stimulant  of 
achievement. 

Is  simply  requiring  self-evaluation  enough, 
or  do  students  have  to  be  taught  how  to 
evaluate  their  work  accurately? 

Students  harbour  misconceptions  about  the 
self-evaluation  process  (e.g. , the  role  that  evi- 
dence plays).  As  a result,  self-evaluation  is 
unlikely  to  have  a positive  impact  on  achieve- 
ment if  these  misconceptions  are  not 
addressed  by  teaching  students  how  to  evaluate 
their  work.  Simply  requiring  self-e\  aluation  is 
unlikely  to  have  an  effect  on  achievement.  Stu- 
dents have  to  be  taught  how  to  evaluate  their 
work  accurately  and  need  time  to  develop  the 
appropriate  skills. 

Are  there  any  benefitsfor  teachers  by  train- 
ing students  in  self-evaluation? 


SelJ-evaluations  that  elicit 
information  about  students’ ejjort, 
persistence,  goal  orientations, 
attributionsfor  success  and  failure, 
and  beliefs  about  their  competence, 
give  teachers  ajuller  understanding 
oj why  students  perform  as  they  do. 


Teaching  self-evaluation  also  has  benefits  for 
teachers.  Teachers  who  participate  in  in-ser- 
vice focused  on  how  to  teach  self-evaluation 
grow  more  confident  in  their  skills  as  teachers 
and  use  a greater  variety  of  assessment  tech- 
niques in  the  classroom. 

In  one  of  our  studies  where  teachers  w ere 
involved  in  action  research  on  student  self- 
evaluation  as  a mechanism  for  professional 
growth,  w'e  found  that  teacher  self-efficacy 
was  enhanced  (Ross  et  al.,  1 999). Teacher-effi- 
cacy is  the  belief  that  teachers,  individually  and 
collectively,  will  be  able  to  bring  about  student 
learning.  There  is  a generative  power  of  teacher 
expectations. Teachers  who  anticipate  that  they 
will  be  successful  set  higher  goals  for  them- 
selves and  their  students,  are  more  willing  to 
engage  in  instructional  experiments,  persist 
through  obstacles  to  implementation,  and  have 
higher  student  achievement. The  connection 
between  teacher  learning  and  student  learning 
is  a critical  and  essential  link. 

What  are  the  greatest  challenges  for  teach- 
ers incorporating  self-evaluation  into  their 
assessment  repertoires? 

One  of  the  greatest  challenges  for  teachers  is 

Section  3 
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the  recalibration  of  power  that  occurs  when 
assessment  decisions  are  shared.  Data  collect- 
ed in  one  of  our  projects  (Ross  at  ah,  1998a) 
suggested  that  teachers  found  it  difficult  to 
share  control  of  evaluation  decision-making,  a 
responsibility  at  the  core  of  the  teacher’s 
authority.  Such  difficulty  may  be  due  to  the  fact 
that  teaching  students  to  be  self-evaluators 
involves  the  implementation  of  fundamental 
changes  in  the  relationship  between  teachers 
and  students  in  the  classroom.  Changing  root 
beliefs,  behaviours  and  relationships  is  difficult 
and  takes  time.  Accordingly,  another  challenge 
is  time.  Teachers  need  considerable  time  to 
work  out  how  to  accommodate  an  innovation 
that  involves  sharing  control  of  a core  teacher 
function  with  their  existing  beliefs  about 
teacher  and  learner  roles.  As  well,  stutlents 
need  time  to  understand  what  self-evaluation 
is  and  how  it  relates  to  their  learning,  in  addi- 
tion to  learning  how  to  do  it. 

Challenges  such  as  these  will  demand  that 
teachers  be  patient  with  the  change  process, 
tor  themselves  and  tor  their  students,  d 
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TIPS  for  Getting  Started  with  Student  Self-Evaluation 


>-  Define  self-evaluation  for  students  (e.g., 
“judging  the  quality  of  your  work”) 

2^  Make  the  benefits  of  self-evaluation  visible  to 
students.  Talk  about  the  benefits,  and  address 
such  benefits  consciously,  both  at  the  begin- 
ning of  the  process  and  throughout. 

Overtly  confront  students’  feelings  and  beliefs 
about  self-evaluation.  This  means  directly 
dealing  with  misconceptions. 

>■  Start  small.  Create  lots  of  small,  short  self- 
evaluation  opportunities  for  your  students. 
These  experiences  may  involve  daily  experi- 
ences with  various  aspects  of  the  Four-Stage 
Model. 

Use  a variety  of  quick  pre-designed  forms  to 
get  your  students  into  the  practice  of  self- 
evaluating  during  or  after  regular  activities 
they  do  in  the  classroom  (see  Roiheiser, 

1996,  for  many  sample  forms). 


2^  Choose  a performance  that  you  and  your  stu- 
dents have  had  some  experience  with  (e.g., 
oral  presentations,  research  reports,  narrative 
writing).  Try  out  the  entire  Four-Stage  Model 
for  this  performance  or  outcome. 

Expect  a range  of  reactions  from  your  students 
as  you  help  them  get  better  at  self-evaluation. 
You  will  have  a continuum  of  responses,  from 
positive  reactions  as  students  see  this  as  ‘fair’ 
assessment,  to  negative  reactions  as  students 
discover  that  sharing  control  also  means  shar- 
ing the  workload. 

>-  Create  col  laborative  conditions  for  your  own 
professional  learning.  Work  with  a peer  or  col- 
league in  experimenting  with  self-evaluation. 
Such  experimentation  will  enhance  personal 
assessment  literacy.  The  constructive  disso- 
nance, social  comparison,  synthesis,  and 
experimentation  that  occur  when  working  with 


others  will  have  a significant  effect  on  your 
learning,  and  ultimately,  on  your  students’ 
learning.  Collaboration  will  help  you  more 
effectively  link  student  learning  and  instruc- 
tional approaches  for  the  purpose  of  continu- 
ous improvement. 

2^  Let  all  stakeholders  (students,  parents,  admin- 
istrators, colleagues)  know  what  assortment  of 
assessment  practices  you  are  using  in  your 
classroom,  and  practice  articulating  a ratio- 
nale for  why  self-evaluation  is  an  important 
part  of  your  assessment  repertoire. 

2^  Trust  that  your  students  can  be  integral  assess- 
ment partners,  and  with  time,  teaching,  and 
co-learning,  that  you  and  your  students  will 
become  better  at  it! 


orbit,  Vol  30,  No  4,  2000 


Donna  C.  Creighton 


What  Do  Rubrics 
Have  to  do  with  Teaching? 


|rcmeml)cr  working  extremely  hard  on  a 
project  about  Farming  when  I was  in  Grade 
3.  I did  research,  learned  special  terminol- 
ogy, painstakingly  created  a 3-D  construc- 
tion paper  model  of  a Farm,  and  presented  my 
work  to  the  class.  I also  remember  feeling  very 
proud  of  this  work  until  1 received  my  mark 
From  the  teacher.  My  personal  Feeling  of 
achievement  was  snuffed  out  by  no  more  than 
two  sentences  and  a letter  grade.  I never 
understood  why  the  teacher  didn’t  see  my 
work  the  way  I did,  and  I was  too  embarrassed 
to  ask. 

Most  people  1 know  can  relate  a similar 
story  From  their  school  experience.  Perhaps 
this  is  why  many  elementary  educators  have 
embraced  the  philosophy  of  authentic  assess- 
ment. This  approach  to  classroom  assessment 
is  based  on  the  belief  that  the  answer  to 
the  question,  “How  am  I doing?”  comes 
from  both  the  student  and  the  teacher,  thereby 
rcmo\ing  the  mystery  of  how  a grade  is 
later  determined.  Hart  (1994,  pp.  10-11) 
says  that  in  their  general  design,  authentic 
assessments: 

^ go  to  the  heart  of  essential  learnings,  to  the 
understandings  and  abilities  that  matter  to  us 
>■  are  educational  and  engaging 
^ are  part  of  the  curriculum  rather  than  arbi- 
trary intrusions  \vith  no  purpose  other  than 
to  “shake  out  a grade” 

^ rellect  real-life,  interdisciplinary  challenges 
^ present  students  with  complex,  open- 
ended  problems  and  tasks  that  integrate 
knowledge  and  skills 

^ olten  culminate  in  student  products  or 
performanccs 

are  standard  setting,  pointing  students 
tow  ard  higher,  richer  levels  of  knowing 
Rubrics,  rating  scales,  and  achievement 
charts  ha\  e become  a readilv  recognizable  and 
popular  component  of  authentic  assessment 


and  are  now  firmly  entrenched  in  our  assess- 
ment and  evaluation  lexicon.  Professional 
books  and  articles,  locallv  and  provincially 
developed  exemplars,  as  well  as  commercial 
teaching  products  provide  us  with  a variety  of 
samples  to  try  out  in  the  classroom.  1 low'cver, 
in  our  haste  to  move  forward,  we  have  often 
left  out  the  most  important  piece:  how 
rubrics  by  their  very  nature  necessitate  partic- 
ular teaching  practices.  Without  attention  to 
how  they  fit  whth  teaching  practices,  rubrics 
have  the  potential  for  becoming  just  another 
mysterious  form  of  student  assessment  and 
evaluation. 

Refocusing  on  the  Intent  of  Rubrics 

Goodrich  ( 1 996)  defines  a rubric  as  “a  scoring 
tool  that  lists  the  criteria  for  a piece  of  work,  or 
‘what  counts’ ...  [Ijt  also  articulates  gradations 
of  quality  for  each  criterion,  from  excellent  to 
poor”  (p.  14).  Rubrics  are  intended  as  commu- 
nication devices  that  clearly  and  precisely  con- 
vey to  students  what  their  target  is  and  what 
they  need  to  do  to  hit  that  target.  However,  this 
belief  is  only  of  value  if  accompanied  by  the 
practice  of  presenting  the  rubric  to  or  con- 
structing it  with  students  prior  to  the  related 
lessons  and  tasks,  rather  than  at  the  end  (Harris 
et  al. , 1 996). 

As  Wiggins  and  McTighe  ( 1 998)  point  out, 
this  practice  of  backward  design  does  not 
come  naturally  to  man)'  teachers  who  are  more 
accustomed  to  (and  perhaps  comfortable  with) 
thinking  like  acti\  ity  designers  rather  than  like 
assessors  (p.  6 5). Through  this  co-construction 
process,  students  and  teachers  look  at  samples 
of  work  that  pro\  ide  exam|rles  of  what  the 
work  looks  like  at  different  levels  and  generate 
the  descriptive  language  together.  Presenting  a 
“stand  alone”  rubric  cannot  achieve  this:  stu- 
dents literallv  need  to  sec  the  different  levels  in 
samples,  analyze  and  tliscuss  how  the  lc^■els  dif- 
fer, and  suggest  revisions  for  improvement 


based  on  criteria  in  the  rubric  (Goodrich, 
1996).  The  classrooms  of  teachers  who  think 
like  assessors,  then,  provide  enlarged  copies  of 
the  rubric  in  use,  explanations  in  student  lan- 
guage of  the  content  standards  or  curriculum 
expectations  being  addressed,  and/ or  samples 
of  work  that  demonstrate  performance  at  the 
different  levels  (using  anonymous  samples  of 
work  from  pre\  ious  classes  or  teacher  created 
samples). 

Ensuring  the  task  is  worthy  of  a rubric:  It's 
all  in  the  verbs! — One  common  trap  into 
which  we  can  easily  fall  is  the  tendency  to 
“over-rubricate”:  either  producing/using 

more  rubrics  than  we  could  j)ossibly  need,  or 
producing/ using  overK  -detailed  rubrics.  But 
when  is  it  appropriate  to  use  a rubric  for  stu- 
dent assessment  instead  of,  say,  a checklist? 
Popham  (1997,  p.  72)  states  that  rubrics  are 
typically  used  to  assess  signijicant  constructed 
responses,  such  as  compositions,  presentations 
or  projects,  are  rarely  used  to  judge  students’ 
responses  on  short-answer  tests,  and  are 
unnecessary  for  scoring  multiple  choice  tests. 
Therefore,  it  is  the  nature  of  the  task  and  the 
information  the  teacher  wishes  to  gather  on 
the  students  that  will  determine  whether  a 
rubric  is  the  appropriate  assessment  tool. 

Performance  or  “rich”  tasks  lend  themselves 
to  rubric-based  assessment,  but  caution  must 
be  taken  in  developing  such  tasks  so  that  they 
become  neither  too  big  nor  too  general.  Per- 
formance tasks  arc  open-ended  and  allow  stu- 
dents to  demonstrate  their  understanding  of 
pre\'iously  addressed  content  by  applying  it  in 
an  authentic  or  “real  life”  \vav.  If  the  goal  is 
teaching  for  understanding,  it  is  critical  to 
mo\'c  bevond  instruction  for  basic  knowledge 
and  comprehension  and  present  opportunities 
for  higher  level  thinking  based  on  that  basic 
knowledge.  Wiggins  and  McTighe  (1998) 
write,  “To  understand  a topic  or  subject  is  to 
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use  knowledge  and  skill  in  sophisticated,  flexi- 
ble ways.  Knowledge  and  skill,  then,  are  neces- 
sary elements  of  understanding,  but  they  are 
not  synonymous  with  understanding...  Stu- 
dents need  to  make  conscious  sense  and  apt  use 
of  the  knowledge  they  are  learning  and  the 
principles  underlying  it”  (p.  24). 

Bloom’s  (1956)  taxonomy  of  cognitive 
skills  provides  an  excellent  way  for  teachers  to 
link  process  verbs  to  products  and  therefore 
raise  awareness  of  how  frequently  the  higher 
levels  of  thinking  are  addressed  (seeTable  1). 
For  example,  elementary  students  are  often 
asked  to  Illustrate  the  story  or  Make  a science 
model,  which  require  thinking  at  the  compre- 
hension and  application  levels.  These  are  types 
of  performances  or  demonstrations,  but  not 
ones  that  are  “rich”  because  they  address  lower 
levels  of  the  taxonomy.  However,  by  changing 
these  tasks  to  Create  an  advertisement  for  the 
story,  or  Design  an  invention  based  on  the  concept 
of.  ..the  teacher  now  requires  students  to  think 
at  the  synthesis  level  and  will  consequently 
have  much  more  information  on  his  or  her 
students.  Does  every  skill  ami  concept  need  to 
be  taken  to  this  level?  First,  it  would  be  impos- 
sible to  do  this  within  the  time  constraints  of  a 
school  year,  because  tasks  of  this  nature  take 
more  time  for  students  to  complete.  Second, 
if  the  design  of  the  performance  or  demon- 
stration is  truly  rich,  it  will  integrate  concepts 
and  skills  from  a number  of  subject  areas,  pro- 
viding the  teacher  with  a lot  of  assessment 
data.  What  is  critical  is  that  the  performance 
task  is  built  upon  concepts  and  skills  previous- 
ly addressed  in  the  classroom,  and  that  it 
allow's  students  to  show  how'  well  they  have 
learned  those  skills  and  concepts  by  applying 
them  in  a new  and  engaging  w'ay.  As  Harris 
et  al.  (1996)  put  it,  “Products  and  perfor- 
mances that  embody  excellence  across  multi- 
ple standards  indicate  an  efficient  teaching 
and  learning  |)rocess  and  a meaningful 
curriculum” (p.  27). 

Avoiding  use  of  rubrics  solely  as  a “destina- 
tion” Without  careful  instruction,  rubrics 
can  become  the  students’  destination  rather 
than  a road  map  for  helping  them  reach  that 
destination.  Rubrics  arc  tools  designed  to  pro- 
vide constructive  feedback  for  students 
through  self-,  peer,  or  teacher  assessment  in 
order  tojurther  develop  skills  or  knowledge.  When  a 


rubric  is  presented  at  the  beginning  of  a unit  of 
study  or  task  and  referred  to  throughout  the 
process  by  the  teacher  and  students,  it 
becomes  an  active  resource  to  guide  students 
through  their  work,  it  also  guides  teachers  to 
the  instructional  needs  of  the  students,  rather 
than  functioning  as  a static  form  of  measure- 
ment or  judgment.  Sound  and  equitable  teach- 
ing practice  means  allowing  students  more 
than  one  “shot”  at  the  target — an  opportunity 
for  an  initial  performance/demonstration 
which  they  self-assess  or  assess  with  the 
teacher  to  identify  areas  for  improvement, 
then  an  opportunity  for  a second,  revised  per- 
formance.This  is  the  one  that  “counts.” 

Using  rubrics  holistically  and  analyti- 
cally— A common  point  of  conf  usion  and  dis- 
cussion centres  around  when  it  is  appropriate 
to  use  a rubric  holistically  or  analytically  when 
looking  at  student  work.  Marzano  ( 1 996)  dis- 
tinguishes the  two  in  this  w^ay: 

“Holistic  scoring  combines  performance 
standards  for  multiple  traits  into  a single 
rubric.  Analytic  scoring  assesses  traits  sepa- 
rately. . . With  holistic  scoring,  a single  rubric  is 
used  and  its  levels  are  composites  of  the  vari- 
ous rubric  levels  for  the  individual  traits 
embedded  in  the  task”(p.  7). 

Marzano  notes  that  holistic  scoring  assesses 
a student’s  most  consistent  level  of  perfor- 
mance, w'hich  can  be  problematic  in  cases 
where  performance  from  trait  to  trait  (or  cate- 
gory) differs  greatly,  such  as  in  this  example: 
Trait  / category  a:  level  3 
Trait  / category  h:  level  3 
Trait  / category  c:  level  3 
Trait / category  d:  level  1 
Marzano  writes,  “Using  the  holistic  rubric 
in  a strictly  logical  fashion,  [this]  student 
would  receive  a score  of  1 even  though  he  had 
exhibited  level  3 performance  on  three  out  of 
four  traits.  The  logic  of  a holistic  rubric 
demands  that  all  traits  at  a given  performance 
level  are  executed  at  least  at  that  level”  (p.  8). 
Analytic  scoring  (i.e.,  item  by  item,  or  skill  by 
skill)  avoids  such  difficult  situations,  but  may 
run  the  risk  of  swinging  too  far  in  the  opposite 
direction,  where  the  skills  being  assessed 
become  too  narrow,  too  discrete,  or  too  limit- 
ing to  lend  themselves  to  multi-level  perfor- 
mance. Harris  et  al.  ( 1996)  assert  that  there 
are  times  when  it  is  appropriate  to  use  one 
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scoring  approach  over  the  other.  For  example, 
analytic  scoring  can  provide  useful  diagnostic 
information  of  a specific  component  of  student 
performance,  allowing  both  students  and 
teachers  to  identify  strengths  and  weaknesses 
and  to  set  goals  for  improvement  (Popham, 
1 999).  Holistic  scoring  encourages  students  to 
think  of  their  work  more  broadly  as  they  strive 
to  hit  the  target  or  standard  described  to  them 
in  the  rubric.  Popham  ( 1999)  suggests  a “mid- 
dle-of-the-road” approach  in  which  teachers 
initially  grade  all  students’  work  holistically, 
“then  return  for  an  analytic  scoring  of  only 
those  responses  that  were  judged,  overall,  to 
be  unsatisfactory”  (p.  148).  The  teacher  then 
works  with  the  student  to  set  goals  for 
improvement  based  on  the  analytic  feedback. 

Putting  It  All  Into  Context 

Rubrics  enable  us  to  define  what  we  are  looking 
for  in  students’  work.  However,  the  expecta- 
tions may  become  too  narrow  if  teachers 
become  too  dependent  on  this  one  assessment 
tool. The  message  that  bears  repeating  over  and 
over  again  is  that  rubrics  are  one  oj many  classroom 
assessment  tools,  and  the  skilled  teacher  is  one 
who  draws  upon  many  forms  of  data  collection 
to  develop  a whole  picture  of  each  student.  O 
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TABLE  1 

: BLOOM’S  TAXONOMY  OF  COGNITIVE  SKILLS 

LEVEL 

DEFINITION 

WHAT  STUDENT 

PRDCESS  VERBS 

PRODUCTS 

DOES 

EVALUATION 

Judging  the 

Gives  value. 

appraise 

decide 

measure 

court  trial 

panel 

value  of  ideas, 

Makes  choices. 

assess 

defend 

prove 

debate 

recommendation 

materials  or 

Arranges  ideas 

award 

determine 

rank 

discussion 

research  paper 

products 

judges  ideas. 

choose 

dispute 

recommend 

editorial 

self-evaluation 

Presents  choices. 

conclude 

editorialize 

reflect 

essay 

survey 

consider 

evaluate 

select 

letter 

criticize 

grade 

test 

critique 

judge 

debate 

justify 

SYNTHESIS 

Putting 

Uses  old  ideas  to 

adapt 

devise 

predict 

abstract 

play 

together 

make  new  ideas. 

advertise 

estimate 

prepare 

advertisement 

poem 

constituent 

Changes  old  ideas. 

blend 

form 

prescribe 

comic  strip 

puppet  show 

parts  or 

Creates  new  ideas. 

change 

formulate 

produce 

conversation 

recipe 

elements  to 

combine 

imagine 

refine 

dance 

song 

form  a new 

compose 

infer 

reflect 

game 

story 

whole 

create 

invent 

role  play 

invention 

■Structure 

design 

modify 

suppose 

magazine 

TV/radio  show 

develop 

originate 

transform 

mural 

toy 

news  article 
|5antomime 

treasure  hunt 

ANALYSIS 

Breaking 

Lot)ks  at  parts. 

analyze 

examine 

relate 

cartoons 

family  graph 

down  an  idea 

Sees  relationships. 

categorize 

explain 

research 

chart 

cjuestionnaire 

into  its 

Organizes  parts. 

classify 

group 

search 

commercial 

report 

constituent 

correlate 

inspect 

separate 

contract 

secret  code 

parts 

diagram 

interpret 

simplify 

diagram 

survey' 

discover 

memorize 

sort 

fact  file 

tree  diagram 

dissect 

order 

survey 

crossword  puzzle 

tlivide 

(seriate) 

uncover 

APPLICATION 

Using 

Applies  previously 

apply 

graph 

record 

collage 

model 

information  in 

learned  information 

chart 

group 

relate 

collection 

photographs 

new  situations 

to  another  situation 

code 

illustrate 

report 

construction 

|3icttire 

or  to  solve  a new 

collect 

interview 

simulate 

diagram 

poster 

problem. 

construct 

manijjulate 

sketch 

diary 

puzzle 

Uses  knowledge. 

demonstrate 

model 

solve 

diorama 

scrapbook 

dramatize 

organize 

track 

display 

sculpture 

examine 

paint 

use 

illustration 

skit 

experiment 

practise 

maj) 

mobile 

stitcherv 

COMPREHENSION 

Understanding 

Organizes 

associate 

distinguish 

reorganize 

choral  reading 

picture  story 

(lowest  level  of 
uiulerstaiKliiig) 

the  information 
being  communicated 

previously  learned 
material  so  that  student 

change 

ex|tand 

extend 

restate 

retell 

demonstrate 
illustrate  story 

retell  storv 

conaparc 

without  relating  it 

can  rejthase  it,  describe 

contrast 

locate 

reword 

interpret 

translate 

to  other  material 

it  in  own  words  explain 

define 

match 

translate 

cross-classification  chart 

or  ideas 

it  or  predict  implications 

differentiate 

outline 

or  ef  fects  on  the  basis 

iliscuss 

para|ihrase 

ol’tlie  known  facts. 

KNOWLEDGE  (memory) 

Learning  the 

Recalls  or  recognizes 

ask 

listen 

recognize 

“fact”  chart 

recite  a poem 

information 

bits  of  information. 

count 

match 

record 

map 

timeline 

define 

memori/c 

retell 

read  a book 

worksheet 

describe 

name 

select 

memorize  information 

draw 

ob.servc 

show 

fill  in 

jjick 

tabulate 

find 

point 

trace 

iticntilv 

cjuote 

underline 

indicate 

read 

write 

label 

recall 
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Tools  and  Strategies 


Ken  O’Connor 

Grading — An  Exercise 
in  Professional  Judgment 


Program  Planning  and  Assessment  {Ontivio  Ministry  of  Education) 

In  Ontario  secondary  schools,  the  value  assigned  (to  represent  the  quality  of  student  work) 
will  be  in  the  form  of  a percentage  grade. 

Assessment  and  evaluation  will  be  based  on  the  provincial  curriculum  expectations  and 
the  achievement  levels  outlined  in  this  document  and  in  the  curriculum  policy  document  for  each 
discipline  (p.9). 

80- 1 00%  Level  4 A very  high  to  outstanding  level  of  achievement. 

70-79%  Levels  A high  level  of  achievement. 

60-69%  Level  2 A moderate  level  of  achievement. 

S0-S9%  Level!  A passable  level  of  achievement. 

<50%  Insufficient  achievement  of  curriculum  expectations,  (p.  1 1 ) 

70%  of  the  grade  for  each  course  will  be  based  on  assessment  and  evaluation  conducted 
throughout  the  course. 

30%  of  the  grade  will  he  based  on  final  evaluation  (using  a)  method  suitable  to  the  course  con- 
tent, and  administered  toward  the  end  of  the  course. 

Evaluation  should  rellect  each  student’s  most  con.sistent  level  of  performance. 


Guide  to  the  Provincial  Report  Card,  Grades  9-12  (Ontario  Ministry  of  Education) 
Students  should  be  given  numerous  and  varied  opportunities  to  demonstrate  the  full  extent  of 
their  achievement  of  curriculum  expectations  (p.  8). 

70%  of  the  grade  will  be  based  on  evaluations  . . . (conducted)  throughout  the  course.  This 
portion  of  the  grade  should  represent  the  student’s  most  consistent  level  of  achievement,  with 
special  consideration  given  to  the  more  recent  evidence  of  achievement. 

30%  of  the  grade  will  be  based  on  . . . final  evaluation  (using  a)  method(s)  of  evaluation  suitable 
to  course  content  and  expectations  . . . and  administered  towards  the  end  of  the  course  (p.  9). 
The  assessment  and  evaluation  of  learning  skills  is  distinct  from  and  should  not  influence  the 
determination  of  percentage  grades  (p.  10). 


“Grading  practices  are  not  the  result  oj  careful 
thought  or  sound  evidence  . . . rather,  they  are  used 
because  teachers  experienced  these  practices  as  stu- 
dents and,  having  little  training  or  experience  ivitb 
other  options,  continue  their  uxe.”(Guskey,  1 999, 

p.  20) 

In  the  past  in  Ontario  there  has  been  consid- 
erable truth  in  this.  The  policy  require- 
ments of  the  new  secondary  curriculum  are 
shining  a light  on  grading  practices  and 
many  teachers  are  re-examining  what  they  tlo. 
This  article  identifies  the  key  aspects  of  the 
new  curriculum  with  regard  to  grading  and  the 
grading  principles,  which  I believe,  should 
guide  grading  practices.  I offer  a practical 
example  wdiich  puts  together  jjolicy  and  prin- 
ciple and  show's  several  approaches  to  deter- 
mining student  grades.  The  bottom  line  is  that 
grading  should  be  seen,  not  merely  as  a numer- 
ical, mechanical  exercise,  but  as  an  exercise  in 
professional  judgment. 

Policy 

The  policy  requirements  of  the  new'  curricu- 
lum arc  found  in  tw'o  documents-  -Program 
Planning  and  Assessment  and  Guide  to  the  Provin- 
cial Report  Card,  Grades  9—12  (Ontario  Ministry 
of  Education,  1999).  The  requirements  arc 
summarized  at  right.  The  most  significant 
tlcpartures  from  past  practice  are  the  require- 
ments that  the  focus  be  on  the  most  consistent 
level  ot  achievement  with  special  considera- 


tion for  more  recent  achievement  and  that 
there  be  clear  separation  of  achievement  and 
learning  skills. 

Principles 

The  follow'ing  guidelines  are  designed  to  sup- 
port learning,  and  to  encourage  student  suc- 
ce.ss  (O’Connor,  1995): 

1 . Limit  the  valued  attributes  included  in 
grades  to  individual  achievement. 

2.  .Sample  student  performance — don’t  mark 
everything. 


3.  “Grade  in  pencil” — keep  records  so  they 
can  be  updated  easily. 

4.  Relate  grading  procedures  to  the  intended 
learning  (outcomes). 

5 . Use  care  “crunching”  numbers. 

6.  Use  criterion-referenced  standards  to  dis- 
tribute grades. 

7.  Properly  record  evidence  from  quality 
assessment  instruments. 

8.  Discuss  assessment  and  evaluation  practices, 
including  grading  with  students  at  the 
beginning  of  instruction. 
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TABLE  1 : Determining  Percentage  Grades  for  Mid-semester/Term  1 


Evaluations  included  in  grade  determination 


UNIT1 

UNIT  2 

UNIT  3 

A Perl.  Task 

□ Test 

G Perf.  Task  i 

B Perl.  Task  ii 

E Pert.  Task  i 

HTest 

CTest 

F Perf.  Task 

1 Perf.  Task  ii 

K/U 

T/l 

C 

A/MC 

Weighting 

25% 

25% 

25% 

25% 

Student  Z 

A 

69 

75 

B 

59 

65 

79 

C 

65 

79 

79 

D 

75 

90 

95 

E 

69 

75 

79 

F 

79 

100 

75 

G 

85 

95 

79 

H 

75 

90 

100 

1 

95 

95 

95 

79 

Report  Card 

Total 

671 

529 

604 

391 

Grade 

2 and/or  4 Mean 

and/nr  4 Madian 

K/U 

T/l 

C 

A/MC 

Student  Y 

A 

6/10 

7/10 

B 

X 

/ 

/ 

C 

65% 

79% 

79% 

D 

3 

4 

4 

E 

/ 

/ 

/ 

F 

3 

4 

3 

G 

4 

4 

3 

H 

79% 

90% 

100% 

Report  Card 

1 

3 

4 

4 

3 

Grade 

Summary 

1 1 

Linking  Policy  and  Principles 

Guideline  #1  is  completely  aligned  with  the 
policy  requirement  to  separate  achievement 
I’rom  learning  skills.  Guideline  #2  links  with 
the  requirement  that  30%  ot  each  student’s 
grade  should  come  from  final  evaluations  (the 
plural  must  be  emphasized)  and  the  inference 
that  the  70%  should  also  be  from  summative 
evaluations  during  each  course.  Guideline  #3 
is  supported  by  the  requirement  that  special 
consideration  be  given  to  more  recent  achieve- 
ment. Guideline  #4  is  operationalized  by  the 
policy  rcc|uircmcnt  that  evaluation  be  based  on 
the  achievement  charts.  In  practical  terms  this 
means  that  the  achievement  chart  categories 
should  be  used  as  the  basis  for  weighting 
grades. Thus  the  achievement  chart  categories 
become  the  “set”  for  weighting,  and  the  assess- 
ment methods  become  the  sub-set.  Guideline 
#5  comes  into  play  through  the  requirement 
to  focus  on  the  most  consistent  level  of 
achic\emcnt,  so  it  is  clear  that  the  determina- 
tion of  grades  should  not  just  be  a number 
crunching  exercise.  Guideline  # 6 is  support- 
ed through  the  link  to  the  achievement  chart 
categories  which  makes  it  clear  that  a criteri- 
on-referenced approach  is  necessary.  Guide- 
line #7  is  acknowletlgcd  in  the  requirement 
for  students  to  have  many  and  \ aried  opportu- 
nities to  demonstrate  their  achievement. 
Guideline  #8  is  not  specifically  included  but  it 
is  certainly  inferred  in  the  principles  in  the  Pro- 
gram Planning  and  Assessment  document. 

Practice 

It  is  not  always  easy  to  imagine  what  abstract 
|n‘inci|)lcs  might  look  like  in  practice. The  follow- 
ing example  is  designed  to  make  some  of  the 
principles  concrete. Table  1 , which  depicts  a page 
from  a grade  book  for  two  students  with  essen- 
tially the  .same  achievement,  illustrates  how  the 
policy  and  principles  can  be  implemented.  It  is 
important  to  note  that  lor  the  \\  hole  reporting 
period  there  are  only  nine  e\  aluations  included 
(Guiileline  #2),  and  that  the  organizing  struc- 
ture for  the  page  is  the  achievement  chart  cate- 
gories. For  each  of  the  nine  evaluations,  scores 
were  recorded  in  the  categories  from  which 
expectations  were  evaluated  - -for  example,  the 
lirst  evaluation  {.\)  included  onlv  evaluations 
Irom  know  ledge/  understanding  and  thinking/ 
inquir\,  while  the  last  evaluation  (I)  included 
expectations  from  all  lour  categories. 


Having  recorded  the  data  in  this  way,  there 
are  several  approaches  that  can  be  taken  to 
determine  report  card  grades — see  Table  2. 
This  continuum  of  approaches  starts  with  tra- 
ditional grading  w here  there  is  no  basis  for 
grades  other  than  a letter/ percentage  relation- 
ship, w here  the  weighting  is  based  on  assess- 
ment methods,  and  where  the  only  calculation 
considered  is  the  mean.  Approaches  #2 
through  #5  utilize  the  achievement  charts  and 
the  brief  descriptions  of  each  level  on  page  1 1 
in  Program  Planning  and  Assessment  as  the  basis 
for  grades,  and  weighting  is  linked  to  the 
achievement  chart  categories. 

Approach  #2  uses  the  mean  as  the  method  of 
calculating  central  tendency.  .Approach  # 3 sug- 
gests an  alternative  numerical  calculation—  the 


median.  (Note  that  the  mode  is  another  possi- 
bility.) Approach  #4  acknowledges  that  evi- 
dence is  now  being  collected  in  \ arious  formats 
(x/  10,  %,  checklists,  level  scores),  but  these 
multiple  measures  arc  converted  to  percent- 
ages; this  approach  uses  calculations  as  in 
approach  #2  or  #3.  Approach  #5  focuses  on 
the  policy  requirements  about  consistent  and 
recent  performance  and  emphasizes  profes- 
sional judgement — based  clearly  on  a body  of 
evidence  and  the  performance  standards  in  the 
curriculum  policy.  In  order  to  put  this 
approach  into  operation  it  is  necessary  to 
acknowledge  that  we  rcallv  cannot  distinguish 
100  points  of  achievement  and  that  it  is  more 
realistic  to  use  a 16-point  scale  with  high,  mid- 
dle and  low  points  in  each  level,  including 
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TABLE  2:  CONTINUUM  OF  APPROACHES  TO  DETERMINING  GRADES 

BASIS  FOR  GRADES 

WEIGHTING  BASE 

GRADE  DETERMINATION 

1 . Numerical  grading  scale 
e.g.,  A = 80-100% 

Assessment  methods 

e.g.,  tests  - 50%,  projects  - 50% 

Mean/Average 

2.  Description  of  levels 
i.e.,  in  words 

Achievement  chart  categories 
e.g.,  standards,  outcomes 

Mean/Average 

3.  Description  of  levels 

Achievements  chart  categories 

Median 

4.  Description  of  levels 

Achievements  chart  categories 

Multiple  measures  converted  to  %,  then  mean  or  median 

5.  Description  of  levels 

Achievements  chart  categories 

Multiple  measures 

- no  conversion/calculation 

- most  consistent  with  consideration  for  more  recent 

- professional  judgment  supported  by  body  of  evidence 

below  50%.  In  level  #4  there  is  also  a fourth 
point  as  100%  must  be  attainable  (see Table  3). 

Conclusion 

1 hope  that  ultimately  all  teachers  in  Ontario 
secondary  schools  will  use  approach  #5.  For 
many  it  would  be  too  big  a step  to  take  at  this 
time,  so  it  is  hoped  that  this  continuum  will  be 
seen  as  a series  of  steps  through  which  teachers 
(individually  and  collectively)  can  move  as  they 
implement  the  new  curriculum  over  the  next 
four  years.  II  they  do  this  they  will  be  bringing 
jjolicy,  principle,  and  practice  together  in  ways 
which  honour  the  professionalism  of  teachers 
and  make  grades  fair  and  honest  summaries  of 
student  achievement.  O 

References 

Guskey,  T.  (Eel.).  (1996).  Commiinicarin^  student  learning. 
Alexandria,  VA:  Association  for  Supervision  and  Curricu- 
lum Development. 

O’Connor,  K.  ( 1999).  The  minJJul  school:  How  to  grade  for 
learning.  City:  Skylight. 

Ontario  Mini.stry  ol  Education.  ( 1 999).  Program  planning  and 
assessment.  Toronto:  Author. 

Ontario  Ministry  of  Education.  (1999).  Guide  to  the  report 
card, grades  9 /2. Toronto:  Author. 


Ken  O’Connor  is  an 
independent  consultant 
on  assessment  and 
evaluation.  A teacher 
since  1967,  Ken  has 
held  various  positions  in 
Ontario  education,  serv- 
ing most  recently  as 
a consultant  on  sec- 
ondary assessment  at 
the  Ontario  Ministry  of 
Education.  He  is  the  author  of  the  very  successful 
OSSTF  resource  book  Assess  forSuccess(1993)  and 
The  Mindful  School:  How  to  Grade  for  Learning  [Sky- 
light, 1999).  He  has  presented  workshops  at  many  con- 
ferences in  Ontario,  Manitoba,  and  the  U.S. 


Table  3:  Converting  from  One  Grading  System  to  Another  - 

Grade  9, 1999/2000 

REPORT  CARD 

ACHIEVEMENT 

LETTER 

MARK  OUT  % GRADE 

% 

DESCRIPTION 

LEVEL 

GRADE 

OF  10 

RANGE 

GRADE 

Avery  high  to  out- 
standing level  of 

A+ 

95,100 

achievement. 

4 

A 

8-10 

80-100% 

87 

Achievement  is 
above  the  provincial 
standard. 

A- 

82 

A high  level  of 
achievement. 

B+ 

78 

Achievement  is  at 

3 

B 

7 

70-79% 

74 

the  provincial 
standard. 

B- 

71 

A moderate  level 
of  achievement. 

C+ 

68 

Achievement 

2 

C 

6 

60-69% 

64 

is  below,  but 
approaching,  the 
provincial  standard. 

C- 

61 

A passable  level  of 
achievement. 

D+ 

58 

Achievement  is 

1 

D 

5 

50-59% 

54 

below  the  provincial 
standard. 

D- 

51 

Insufficient  achieve- 
ment of  curriculum 

45 

expectations. 

Below 

4 

Below 

40 

A credit  will  not  be 
granted. 

Level  1 

50% 

35 
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Dealing  with 
Lates  and  Absences 


Tl  he  release  of  the  new  secondary  school 
curriculum  by  the  Ministry  of  Educa- 
tion and  Training  in  the  Spring  of  1 999 
marked  a significant  shift  in  assessment 
|-)hilosophv  and  practice  in  Ontario,  and  caused 
some  consternation  and  controversy  among 
the  teachers  of  the  province.  Policy  statements 
and  the  design  of  the  new  report  card  seemed 
to  indicate  that  teachers  would  no  longer  be 
able  to  deduct  late  penalties  of  as  much  as  ten 
percent  per  day  from  the  grades  on  their  stu- 
dents’ assignments.  Many  teachers  felt  they 
would  lose  a key  tool  for  motivating  students 
to  submit  work  in  a timely  fashion,  and  that 
students  would  take  aeb  antage  of  a system  that 
recognized  their  inabilitv  to  meet  deadlines 
with  the  initial  “N”  (standing  for  “needs 
improvement”). 

This  article  presents  some  background  on 
the  issue  of  late  assignments,  and  some  strate- 
gies for  those  teachers  who  are  looking  for 
.su]iport  in  approaching  the  issue  of  separating 
student  achievement  from  learning  skills.  Pro- 
posed practices  are  based  on  the  work  of 
Richard  Stiggins,  Grant  Wiggins,  and  Ken 
O’Connor,  current  researchers  and  writers 
on  student  assessment.  They  are  also  drawn 
from  conx'crsations  with  teachers  in  the 
Ibronto,  York  Region,  Simcoe,  Peel,  and 
Hamilton  school  boards,  and  from  teacher 
beha\iours  documented  in  the  studies  of 
l)r.  Alan  King  and  Marjorie  Peart  in  the  Good 
Schools  literature  dcyclopcd  under  the  spon- 
soi'ship  of  the  Ontario  Secondary  School 
Teachers’  Federation. 


Grades  9 to  1 2 states  in  section  6.2.1: 

“Assessment  is  the  process  of  gathering 
information  from  a variety  of  sources  (includ- 
ing assignments,  demonstrations,  projects, 
performances,  and  tests)  that  accurately 
reflects  how  well  students  are  achieving  the 
curriculum  expectations.  As  part  of  assess- 
ment, teachers  provide  students  with  descrip- 
tive feedback  that  guides  their  efforts  tow'ards 
improvement.  Evaluation  is  the  process  of 
judging  the  quality  of  a student’s  work  on  the 
basis  of  established  achievement  criteria,  and 
assigning  a value  to  represent  that  quality.” 

The  same  message  is  echoed  in  I'he  Ontario 
Curriculum,  Grades  9 and  10:  Program  Planning 
and  Assessment  : 

“Assessment  and  evaluation  w ill  be  based  on 
the  provincial  curriculum  expectations  and  the 
achievement  levels  outlined  in  this  document 
and  in  the  curriculum  policy  document  for 
each  discipline”  (p.  9) 


The  Ontario  Curriculum,  Policy  Statements 

1 he  new  secondarv  school  documents, 
grounded  in  the  j^hilosophy  and  principles  of 
rcsults-based  education,  set  forth  assessment 
and  e\  ablation  issues  lor  educators  w hich  mark 
a departure  from  jiractices  which  have  been 
usual  for  decades.  Ontario  Secondarv  Schools 


The  policy  statements  seem  to 
suggest  that  the  place  where  that 
habit  oj lateness  will  he  reported  is 


under“Learning  Skills.” 


The  Guide  to  the  Provincial  Report  Card,  Grades 
9-12  is  even  more  explicit  in  separating 
achievement  of  the  curriculum  expectations 
from  learning  skills,  stating: 

“Evaluation  of  learning  skills  must  not  be 
included  in  the  determination  of  percentage 
grades,  which  reflect  only  the  student’s 
achievement  of  the  curriculum  expectations” 
(p.5). 

The  Guide  also  defines  some  of  the  specific 
learning  skills  issues;  for  example,  “regularly 
completes  assignments  on  time  and  with  care,” 
and  “demonstrates  persistence  in  bringing 
tasks  to  completion,”  under  the  heading 
“Works  Independently.”  The  Minister  of  Edu- 
cation, the  Honourable  Janet  Ecker,  stated  in 
the  fall  of  1 999  that  students  who  are  late  with 
their  work  or  show  poor  work  habits  can 
expect  to  see  that  reflected  in  their  report 
card. 

The  purpose  of  this  new  direction  is 
twofold: 

1 . to  ensure  that  student  achievement  of  the 
expectations — or  clear  learning  targets,  as 
Stiggins  and  others  call  them  is  accurately 
represented,  unclouded  by  issues  of  student 
behaviour  or  classroom  management  styles; 
and 

2.  to  provide  students  and  parents  with  very- 
accurate  information  about  students’ 
strengths  and  weaknesses  so  that  they  can  set 
goals  for  improved  student  learning. 

These  purposes  are,  once  again,  revealed 
with  some  clarity  in  the  Guide  to  the  Provincial 
Report  Card: 

“The  Provincial  Report  Card  focuses  on  two 
distinct,  but  related,  aspects  of  student 
achievement:  (1)  the  achievement  of  curricu- 
lum expectations,  and  (2)  the  development  of 
learning  skills.  Accordingly,  the  rejiort  card  has 
separate  sections  for  reporting  on  the  student’s 
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Adolescents  are  still  learning 
appropriate  time  management 
strategies.  They  are  typically 
more  emotional  than  rational. 


demonstration  ot  skills  required  for  effective 
learning.  By  separating  these  two  aspects  of 
achievement,  the  report  card  allows  teachers 
to  provide  more  specific  inlormation  to  par- 
ents and  students  and  to  identify  more  clearly 
the  student’s  strengths  and  areas  in  which 
improvement  is  needed”  (p. 4). 

Late  Assignments  and  Late  Penalties 

Learning  skills  are  the  essential  foundation  for 
lifelong  learning,  and  the  new  curriculum  does 
not  even  implicitly  suggest  abandoning  them  as 
a focus.  In  reconciling  their  concerns  about  the 
issue  of  late  assignments,  teachers  need  to  con- 
sider how  well  the  penalties  they  have  ap|3lied 
in  the  past  have  worked  to  influence  students 
towards  a productive  outcome.  It  is  likely  safe 
to  say  that  most  students  do  not  wish  to  submit 
assignments  after  the  due  date,  but  late  assign- 
ments may  be  the  result  of  several  situations. 

Adolescents  are  still  learning  appropriate 
time  management  strategies. They  are  typically 
more  emotional  than  rational  and  may  priori- 
tize the  demands  of  their  lives  based  on  the 
impulse  or  feeling  of  the  moment  rather  than 
on  the  reality  of  organizing  their  school  obliga- 
tions. Thus,  a late  assignment  may  be  due  to 
faultv  judgement  about  managing  time.  Anoth- 
er aspect  of  flawed  time  management  may  be 
the  inability  to  gauge  the  amount  of  work 
required  to  complete  the  assignment  success- 
fully, and  students  may  leave  too  much  of  the 
work  until  it  is  too  late  to  complete  it  satisfac- 
torily for  the  deadline.  Some  students  may  not 
submit  assignments  because  they  feel  that 
there  is  little  hope  of  a good  result.  Here,  they 
may  be  indicating  that  more  clarity  and  infor- 
mation around  the  specifics  of  the  assignment 
are  necessary,  or  that  there  are  component 
skills  of  that  assignment  which  they  have  not 
developed  sufficiently  to  execute  for  a good 
result. 


Ultimately,  teachers  who  are  using  late 
penalties  must  ask  themselves  the  questions: 
Have  late  penalties  produced  the  desired  result 
of  improved,  on-time  achievement  of  assigned 
tasks?  Have  they  influenced  the  behaviour  of 
individual  students  favourably?  Do  late  penal- 
ties make  adequate  allowance  for  individual 
learning  needs  and  respect  the  fact  that  stu- 
dents may  be  at  very  different  places  on  a con- 
tinuum of  learning  skills?  And  finally,  in  terms 
of  student  achievement,  is  time  the  constant 
and  quality  achievement  the  variable,  or  is 
quality  achievement  the  constant,  and  time  the 
variable — within  reason? 

Current  Assessment  Philosophy 

The  issue  of  lateness  is  not  addressed  directly 
in  much  ot  the  current  assessment  literature; 
however,  authors  such  as  Stiggins,  Wiggins, 
and  others  suggest  an  assessment  philosophy 
which  points  to  a clear  direction  on  this  issue. 
In  his  “Assessment  Bill  of  Rights,”  Grant  Wig- 
gins maintains  that  students  are  entitled  to, 
among  other  things,  “clear,  aj^t,  and  consistently 
applied  teacher  criteria  in  grading  work,  pub- 
lished models  of  excellent  student  work  that 
demonstrates  the  standards,”  and  “ample 
opportunity  to  produce  work  that  [they]  can 
be  proud  of — this  includes  the  opportunity 
for  students  to  self-assess  and  correct  their 
work”  (p.  28).  Wiggins  suggests  that  teachers 
consider  the  student  to  be  an  apprentice  who 
should  have  access  to  models  and  feedback  in 
learning  and  assessment  so  that  they  can  have 
repeated  opportunities  to  master  the  standards 
(p.  49). 

Richard  Stiggins  also  raises  the  issue  of  “sec- 
ond chance  assessment”  similar  to  the  point 
Wiggins  makes  about  seeing  the  student  as  an 
apprentice.  Stiggins  advises  teachers  to  be  sure 
students  are  in  a position  to  use  assessment 
results  effectively  and  efficiently  to  promote 
their  own  academic  well-being  (p.  384).  He 
even  suggests  phrases  for  teacher  dialogue 
with  students  who  wish  or  need  to  improve 
their  performance:  “Do  you  want  to  practise 
now  and  redo  the  assessment?  If  you  do,  I will 
reevaluate  your  performance — no  penalties. 
But  that  re-evaluation  will  need  to  fit  into  my 
schedule”  (p.  426). 

Ken  O’Connor  docs  deal  directly  with  the 
issue  of  late  work,  finding  two  problems  with 


approaches  that  deduct  1 0%  per  day  to  a maxi- 
mum of  50%,  or  similar.  He  points  out  that  the 
penalty  here  distorts  student  achievement  and 
thus  contributes  to  a mark,  and  ultimately  a 
grade  that  does  not  have  clear  meaning.  He  also 
comments  on  such  penalties  as  a disincentive 
for  students  to  complete  work,  suggesting 
instead  that  students  always  be  encouraged  to 
submit  work  on  time,  and  that  penalties  be 
kept  as  small  as  possible — 1 % or  2%  per  day  to 
a maximum  of  1 0% — so  as  not  to  overly  dis- 
tort real  student  achievement.  O’Connor 
advises  recording  the  fact  of  the  tardiness  to 
keep  track  of  a reporting  (not  a grading)  vari- 
able (pp.  49-50). 

Teacher  Practices  to  Promote  Achieve- 
ment —There  are  a number  of  preventative 
measures  that  many  teachers  take  to  ensure 
that  students  have  every  opportunity  to  pro- 
duce quality  work  on  time.  There  are  also 
strategies  which  teachers  use  to  provide  win- 
dows of  opportunity  for  students  to  submit 
assignments.  And,  if  students  are  to  understand 
the  nature  of  their  responsibility,  they  need  to 
have  opportunities  to  discuss  the  issue  of  meet- 
ing deadlines  in  the  classroom. 

Many  teachers  assume  that  students  wish 
to  be  successful  in  school,  and  then  they  set 
up  the  conditions  for  success.  They  present 
tasks  that  are  a significant  and  interesting 
challenge  to  students. They  scaffold  the  work, 
providing  pertinent  instruction,  modeling, 
and  exemplars  so  that  students  can  get  a clear 
picture  of  what  is  required,  and  a sense  of 
how  to  get  there.  Stiggins  points  out  that  stu- 
dents will  take  responsibility  for  their  own 
success  if  they  can  perceive  the  route  to  suc- 
cess; they  “can  reach  any  target  they  can  see 
and  that  stands  still  for  them”  (as  quoted  in 
Earl  and  Cousins).  To  help  students  better 
shape  their  quality  product,  teachers  “stage” 
the  work,  setting  mini-deadlines  when  stu- 
dents must  produce  portions  of  work  in  class 
prior  to  the  ultimate  due  date.  These  oppor- 
tunities allow  teachers  to  check  on  student 
progress,  ask  key  questions  about  student 
processes,  and  provide  valuable  feedback  or 
re-teaching  to  ensure  that  concepts  and  orga- 
nization are  well  understood.  With  these 
checking  points,  teachers  can  be  well  aware 
of  students  who  are  having  difficulties  and 
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who  may  rcc|uire  extra  assistance  tcj  produce 
a timely  j^iece  oFwork. 

Teachers  From  many  Toronto-area  boards 
have  also  shared  their  strategies  For  collecting 
student  work  while  avoiding  the  use  oF  late 
penalties.  There  are  teachers  who  create  a 
long-range  plan  with  all  test  and  assignment 
dates  set  and  presented  to  students  at  the 
beginning  oFthc  term  or  semester.  The  ad\  an- 
tage  here  is  that  students  have  a sense  oF  what  is 
coming,  will  likely  have  well-timed  reminders 
ot  the  crucial  dates,  and  be  given  class  time  to 
discuss  and  prepare  For  the  upcoming  tasks. 
Some  teachers  jjreFer  to  negotiate  an  assign- 
Tiient  due  date  with  students,  providing  a one 
or  two  day  leeway  to  take  into  account  other 
school  c\  cnts — tests  or  assignments  in  other 
subject  areas,  large  extra-curricular  commit- 
ments such  as  a school  musical— which  may 
interlere  with  the  original  chosen  date.  Other 
teachers  pro\ide  a Five  to  seven  day  window 
during  w hich  some  assignments  are  collected 
each  day  from  a number  oF students.  Still  oth- 
ers will  accept  assignments  up  to  the  day 
before  they  jilan  to  return  the  entire  set  oF 


papers.  And  there  are  those  teachers  who 
operate  on  the  principle  oF  continuous  intake 
oF  assignments  with  students  tracking  their 
own  submissions  on  a chart  mounted  on  a 
classroom  bulletin  board,  providing  that  all 
assignments  are  submitted  no  later  than  two  or 
three  weeks  prior  to  the  end  of  the  term  or 
semester. 

Whatever  the  method,  teachers  should  Feel 
that  they  have  control  of  the  process  while  still 
providing  a measure  oF  flexibility  For  students 
to  tlevelop  a sense  oF  responsibility  and  suc- 
cess. Teachers  who  Feel  overwhelmed  with 
marking  should  consider  providing  Fewer  sum- 
mative  tasks,  making  significant  efforts  to  help 
students  improve  their  achievement,  rather 
than  many  opportunities  for  students  to  repeat 
the  same  mistakes.  King  and  Peart  comment  in 
The  Numbers  Game,  “Teachers  would  certainly 
prefer  students  to  be  successful  in  their  cours- 
es, and  make  special  efforts  to  motivate 
and  help  them  by  re-testing,  offering  bonus 
marks  and  giving  them  individual  help  after 
class”  (p.  1 80). 

Establishing  a Culture  oj  Responsibility 
Both  Stiggins  and  Wiggins  suggest  the  impor- 
tance oF  taking  the  mystery  or  secrecy  out  oF 
the  assessment  process.  To  this  end,  with 
regard  to  the  issue  of  late  work,  it  makes  sense 
to  engage  students  in  some  dialogue  about  the 
reasons  For  deadlines  and  the  importance  of 
submitting  work  on  time.  In  this  way,  students 
will  have  knowledge  which  will  help  them  to 
develop  an  “internal  locus  of  control”  so  that 
they  can  manage  their  own  “academic  well- 
being”  (phrases  From  Stiggins,  p.  403).  In  order 
to  approach  the  issue  of  responsibility  with 
students,  some  of  the  Following  steps  may  be 
helpful: 


1.  Establish  a school  (preferably)  or  depart- 
mental policy  which  identifies  key  learning 
skills  w'hich  students  have  a responsibility  to 
demonstrate — For  example, 

punctual  and  regular  attendance 
responsibility  for  comj^leting  tasks,  includ- 
ing all  work  missed  when  absent  From  class 
completion  of  assignments  on  time  and 
with  care 

working  consistently,  effectively,  and  coop- 
eratively to  meet  the  requirements  of  each 
course 

2 . Discuss  with  students  the  issue  of  deadlines, 
the  reasons  For  them  and  the  importance 
of  meeting  them.  Invite  students  to 
share  experiences  they  have  had  or 
know  about  which  show  the  importance  of 
deadlines  and  the  consequences  of  not 
meeting  them. 

3.  Explain  clearlv  the  importance  to  you  and 
to  the  students  For  submitting  assignments 
on  time.  You  teach  other  classes  and  wish  to 
put  a quality  effort  into  assessing  the  needs 
and  achievement  of  all  your  students.  You 
also  wish  to  move  on  to  other  work,  ensur- 
ing that  students  have  the  prerequisite 
knowledge  before  you  proceed. 

4.  Assure  students  that  you  are  aware  of  the 
Fact  that  they  have  assignments  anil  tests  for 
other  subjects,  and  that  there  can  be  some 
flexibility  within  a reasonable  time  Frame 
around  due  dates  if  students  make  you 
aware  of  their  other  obligations. 

5.  Allow  For  the  possibility  that  there  may  be 
some  occasions  when  certain  obstacles  may 
interfere  with  a student’s  comj^letion  of 
work,  and  encourage  individuals  to 
approach  you  ahead  of  due  dates  if  possible 
with  their  concerns  or  difficulties. 


Are  deadlines  absolute  in  the  “real"  world? 


Yes  and  no,  but  you  have  to  know  which — ; 
some  examples: 

A closing  on  a house  is  negotiated,  but  then 
becomes  a legal  deadline.  Breaching  the  clos- 
ing date  could  result  in  a lawsuit. 

>■  Court  appearances  and  trial  dates  are  negoti- 
ated; postponements  may  be  requested,  and, 
given  the  circumstances  and  consent  of  all 
parties,  are  granted.  Once  the  date  has  been 


set,  parties  risk  a charge  of  contempt  of  court 
which  may  entail  fines  or  even  jail  time  if  they 
don't  appear.  Or  a person  could  be  convicted 
In  his/her  absence. 

Job  application  deadlines  can  be  absolute— -a 
specific  day  and  time — or  may  be  continuous 
intake — you  submit  your  completed  form  and 
wait  to  be  called.  If  you  miss  a deadline,  you 
will  not  be  considered  for  the  job. 


>■  Publishers  set  deadlines  for  authors  to  com- 
plete books  or  articles.  These  deadlines  may 
be  re-negotiated,  depending  on  the  type  of 
publication. 

Newspapers  set  deadlines  for  copy  and  for 
advertising.  Copy  deadlines  may  be  negotiat- 
ed, depending  on  the  size  and  complexity  of 
the  story;  advertising  deadlines  are  usually 
firm. 
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6.  Provide  a reasonable  time  frame  w'ithin 
w'hich  assignments  will  be  accepted. 

7.  Establish  fair  consequences  for  work  not 
submitted  on  time  which  place  the  emphasis 
on  achievement,  e.g. , make-u|i  responsibili- 
ty, parent  contact,  out  of  class  follow-up. 

8 . Take  significant  actions  early  in  the  game  to 
help  students  break  old,  bad  habits  such  as 
failure  to  do  assignments  or  tests.  Involve 


Whatever  the  method,  teachers 
shouldjeel  that  they  have  control 
oj the  process  while  still  providing  a 
measure  of  flexibility Jor  students. 


them  in  encouraging  dialogue  and  specific 
instruction.  Contact  parents  for  assistance 
and  support. 

9.  Help  students  to  understand  why  they  may 
be  having  difficulty  submitting  assignments 
on  time  and  show  them  how  to  take  some 
initiative  to  identify  their  particular  prob- 
lem and  to  seek  assistance  in  solving  it. 

10.  Let  students  know  very  clearly  that  you 
cannot  give  them  a grade  on  work  that  they 
do  not  submit. To  earn  the  credit,  they  must 
demonstrate  that  they  can  meet  the  expec- 
tations in  your  subject. 

To  ensure  that  students  have  every  opportu- 
nity to  submit  quality  work  on  time,  teachers 
also  need  to  establish  clearly  (on  paper)  the 
expectations  for  the  task  or  assignment,  help 
students  to  get  an  even  better  “picture”  of  the 
task  by  using  exemplars  which  they  can  de- 
construct, provide  formative  experiences 
such  as  sample  matching  or  peer  feedback, 
and  support  those  students  who  will  pre- 
dictably struggle  with  the  task  without  inter- 
vention. Teachers  may  wish  to  empower 
students  to  deal  with  their  own  difficulties  by 
sharing  self-rellection  strategies  such  as  those 
in  Figure  2. 

Next  Steps 

The  new  curriculum  policy  and  the  new 
report  card  in  Ontario  represent  a next  step  in 
assessment  philosophy  which  many  teachers, 
clearly,  are  preparing  to  take.  New  methods  of 
tracking  student  achievement  separate  from 
learning  skills  will  require  a shift  in  thinking. 
Some  teachers  may  be  skeptical  about  the  effi- 


cacy of  providing  more  accurate  details  about 
students’  strengths  and  weaknesses  until  they 
can  discern  the  ways  in  which  that  information 
resounds  with  students,  parents,  and  the  wider 
community. 

And  the  implementation  dip  will  mean  that 
change  requires  a great  deal  of  thinking  and 
work  to  get  new  systems  up  and  running  in  the 
classroom.  However,  the  possibility  exists  for 
students  to  develop  a very  clear  understanding 
of  their  abilities  and  responsibilities,  and  hope- 
fully, with  more  information  available  to  them, 
teachers,  students,  and  parents  will  be  empow- 
ered to  make  a difference  in  achievement,  and 
to  provide  high  level  learning  for  a greater 
number  of  students.  O 
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Why  is  your  assignment  iate? 


A.  You  could  have  done  it,  but  did  not: 

>-  Was  there  a personal  difficulty  which  prevent- 
ed you  from  completing  the  assignment  on 
time? 

Were  you  disorganized?  Did  you  simply  pro- 
crastinate? Refuse  to  get  down  to  work? 

Do  you  have  too  much  on  your  plate — too 
many  activities  in  which  you  are  involved? 

Are  you  lazy  and  you  don’t  really  care?  (Not  too 
many  students  fit  here.) 

^ Do  you  have  a perfectionist  complex— that  is, 
you  can’t  bear  to  begin  something  unless  you 


know  it  can  reach  the  ideal  vision  in  your 
mind? 

B.  You  could  not  do  the  assignment: 

You  lacked  understanding  of  parts  or  all  of  the 
assignment,  or  the  task  description  was  too 
complex  or  demanding. 

Assignments  which  seem  straightforward  for 
most  are  very  difficult  and  time-consuming  for 
you. 

>■  You  realize  that  you  lack  some  basic  skill  sets 
underlying  the  assignment,  e.g.  research 


skills,  organizational  skills,  reading  skills,  writ- 
ing skills. 

Take  charge:  Know  when  and  whom  to  ask  for 
help  with  any  of  these  situations. 

Can  your  teacher  help? 

>-  Can  your  parents  or  an  older  brother  or  sister 
provide  some  assistance  or  advice? 

Is  peer  tutoring  or  extra  help  available  in  the 
subject  causing  you  difficulty? 
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Barb  Bower  and  Carol  Rolheiser 


Portfolio 
Assessment - 
Organizing  for  Success! 


As  the  movement  toward  greater  account- 
ability and  standardized  testing  has 
grown,  so  too  has  the  movement  to 
explore  alternative  assessment.  Increas- 
ingly, educators  are  exploring  the  |50ssibilities 
of  one  notable  mode  of  alternative  assess- 
ment— portfolio  assessment.  Portfolios  can 
he  part  of  a balanced  approach  to  assessment 
that  enables  educators  to  create  multi-dimen- 
sional  portraits  of  learners.  '!  he  challenge  for 
teachers  in  incorporating  portfolios  into  their 
repertoire  of  assessment  and  evaluation  prac- 
tices is  finding  ways  to  make  the  process  man- 
ageable, both  for  them  and  for  their  students. 
Regardless  of  the  educational  setting  in  w hich 
portfolios  are  used,  there  are  a number  of 
common  areas  that  demand  decision-making. 
A flexible  framev\  ork  known  as  “The  Portfolio 
Organizer”  helps  teachers  to  make  key  deci- 
sions about  the  portfolio  model  that  they  wish 
to  use  with  their  students.  The  Organizer  can 
also  he  used  to  assist  in  the  design  of  teachers’ 
|M'ofessional  portfolios. 

The  Organizer  outlines  ten  key  areas  of 
decision-making.  These  areas  are  outlined 
below,  along  with  brief  descriptions.  Whether 
you  teach  at  the  elementary,  middle  school, 
high  school  or  univcrsitv/collegc  level,  these 
areas  can  he  ada|)tcd  in  orrlcr  to  create  a port- 
folio model  that  will  he  meaningful  as  well  as 
manageable. The  ten  areas  are  not  sequential, 
hut  rather,  are  fluid,  requiring  attention  jarior 
to  portfolio  implementation,  as  well  as 
throughout  the  evolution  of  the  jaroccss. 

1.  Determining  the  Basics 
of  Student  Portfolios 

Initially,  kev  decisions  need  to  he  made  regard- 


“For  those  who  saj  portfolio  assessment 

is  challenging,  time-conouming,  and 

complex,  we  agree;  but  good  teaching 

and  learning  are  all  these  things” 

ing  the  following:  purpose,  type,  audiences 
and  time  frame  for  the  portfolio.  The  purpose 
must  be  made  clear  from  the  very  beginning  of 
the  process,  because  it  influences  so  many 
other  decisions  that  will  be  made  later  on.  For 
example,  your  purpose  might  be  to  involve 
students  in  choosing  key  pieces  of  work  and 
self-evaluating  those  pieces.  If,  on  the  other 
hand,  your  purpose  is  to  have  students’  portfo- 
lios contain  work  samples  that  are  connected 
to  specific  learning  expectations  or  standards, 
then  your  decisions  regarding  how  work  is  col- 
lected, selected  and  evaluated  will  he  affected. 

The  tv|ic  of  portfolio  that  your  students 
maintain  is  also  important.  A “best  work” 
model,  for  example,  will  contain  students’ 
best  efforts  only,  while  a “growth”  model  will 
contain  samples  of  work  that  reflect  students’ 
growth  over  time,  including  strengths  and 
weaknesses.  Each  model  has  its  advantages  and 
disadvantages,  and  each  influences  what  stu- 
dents select  to  put  into  their  portfolios  in 
order  to  create  portraits  of  themselves  as 
learners. 

Amliences  for  the  portfolio  will  impact  the 
process  as  a whole.  Are  other  educators,  par- 
ents or  other  students  going  to  view  students’ 
work?  Students  need  to  know  this  from  the 
beginning,  because  it  mav  influence  the  learn- 


ing samples  that  they  choose  as  well  as  the  con- 
tent of  the  reflections  on  their  work. 

The  time  frame  for  the  portfolio  is  also 
important. This  may  be  influenced  by  key  dates 
in  a school’s  calendar,  for  example,  final  exam- 
ination dates  or  reporting  periods.  Teachers 
may  design  a portfolio  model  that  focuses  on 
documenting  learning  carried  out  over  a short 
period  of  time,  such  as  during  a specific  unit  or 
theme.  Conversely,  they  may  choose  to  have 
students  select  and  reflect  on  their  work  over 
an  extended  period  of  time,  such  as  a full  term 
or  year. 

2.  Selecting  Categories  for  Entries 

Portfolio  entries  need  to  be  organized  so  that  a 
broad  range  of  students’  abilities  and  talents 
can  be  incorporated  into  the  collections  of 
work.  Categorizing  entries  ensures  that  stu- 
dents’ work  is  targeted  appropriately  to  rele- 
vant areas  of  learning.  A “Multiple 
Intelligences”  portfolio,  for  example,  might 
include  categories  based  on  the  key  intelli- 
gences identified  by  I loward  Gardner  (1983). 
Alternatively,  a mathematics  portfolio  might 
include  categories  based  on  the  units  of  the 
course,  so  that  students  wouhl  he  sure  to 
include  pieces  of  work  reflecting  their  efforts 
in  various  aspects  of  the  curriculum.  The  cate- 
gories helj)  guide  both  the  teacher  (i.e.,  in 
ensuring  that  learning  experiences  are  target- 
ed to  these  categories)  and  students  (i.e.,  in 
ensuring  that  learning  samples  are  selected  for 
these  categories). 

3.  Identifying  Learning  Expectations  and  Criteria 

Kev  learning  expectations  and  evaluation  cri- 
teria need  to  be  outlined  at  the  beginning  of 


Section  3 


47 


Tools  and  Strategies 


the  portfolio  process.  These  might  be  based  on 
prescribed  curriculum  achievement  cate- 
gories, or  they  might  be  chosen  through  a 
process  of  negotiation  between  the  teacher  and 
students.  For  example,  if  problem  solving  is  to 
be  an  aspect  of  students’  achievement  demon- 
strated in  their  portfolios,  then  this  would  be 
identified  at  the  beginning  so  that  learning 
samples  involving  problem  solving  would  be 
selected  by  the  students  for  inclusion  in  their 
portfolios.  If  the  portfolios  are  to  be  graded, 
then  descriptors  (as  in  a rubric)  would  have  to 
be  provided  for  students  early  on  so  that  they 
would  clearly  know  what  was  expected  of 
them.  This  initial  area  of  decision  making, 
therefore,  is  related  directly  to  area  #9  of  the 
Organizer — Evaluation  and  Grading.  Clarity 
of  these  early  decisions  ensures  that  later  port- 
folio judgments  are  viewed  as  fair  by  all  portfo- 
lio stakeholders,  especially  the  students. 

4.  Learning  Samples 

Learning  samples  are  the  pieces  of  work  that 
students  produce — the  evidence  of  their 
learning.  Ideally,  students  have  a great  deal  of 
choice  as  to  what  goes  into  their  portfolios. 
This  is  key  to  ownership  and  student  involve- 
ment in  the  process. This  choice,  however,  is 
guided  by  decisions  made  by  the  teacher  and 
students  regarding  the  portfolio  purpose  and 
type,  along  with  the  categories,  learning 
expectations  and  criteria.  At  the  same  time,  a 
teacher  may  want  to  have  certain  learning  sam- 
ples included  in  the  students’  portfolios. This  is 
reasonable  provided  that  the  students  know 
before  they  do  the  work  that  particular  sam- 
ples will  be  included  in  their  portfolios. 

5.  Reflections 

Rellections  are  the  most  critical  components 
of  the  portfolio  process,  because  in  doing  them 


students  develop  metacognition;  they  think 
about  their  own  learning  and,  ideally,  identify 
their  own  strengths  and  areas  for  growth.  Each 
learning  sample  in  a portfolio  should  be 
accompanied  by  a reflection  that  indicates  why 
the  sample  was  chosen,  and  what  that  sample 
reveals  about  the  student’s  learning.  A portfo- 
lio entry,  then,  consists  of  a learning  sample 
plus  a reflection.  In  the  beginning,  modelling 
reflections  for  students  helps  them  to  deepen 
their  own  thinking.  Providing  a variety  of 
“prompts”  or  starters  is  also  important  (e.g. , 
“This  learning  sample  is  important  to  me 
because...”;  “This  work  shows  that. ..”).  The 
process  of  reflection  is  what  differentiates  a 
portfolio  from  a work  folder,  and  it  is  what 
enables  teachers  to  “see”  into  their  students’ 
hearts  as  well  as  into  their  heads. 

6.  Storing  and  Organizing  Portfolios 

Decisions  need  to  be  made  with  re.spect  to  the 
type  of  portfolio  “container”  used  as  well  as 
available  storage  space  in  the  classroom.  Port- 
folios can  be  kept  in  binders,  folders  with 
pockets,  pizza  boxes,  etc.,  depending  on  the 
age  level  of  students  as  well  as  on  the  size  and 
type  of  learning  samples  that  will  be  placed 
into  the  portfolios.  Storage  of  the  portfolios 
will  depend  on  space  availability  as  well  as 
security  concerns.  Students’  work  should  be 
accessible  (e.g.,  in  a filing  cabinet  drawer)  but 
it  should  also  be  kept  somewhere  safe  so  that 
students’  privacy  is  respected  and  their  work 
will  not  be  lost  or  disturbed. 

Organizing  the  contents  of  a portfolio  can 
be  facilitated  by  the  use  of  a table  of  contents.  A 
working  table  of  contents  may  be  maintained 
over  the  course  of  a term , as  students  date  and 
title  work  that  they  place  into  their  portfolios. 
A final  table  of  contents  that  is  polished  and 
organized  in  a sjiecific  way  (e.g.,  chronologi- 
cally or  favourite  work  first)  then  may  be  cre- 
ated at  the  end  of  the  process,  so  that  audiences 
for  the  portfolio  can  scan  it  quickly  in  order  to 
see  what  the  portfolio  contains. 

7.  Sharing  the  Learning 

A particularly  important  component  of  port- 
folio assessment  is  the  sharing  of  students’ 
learning.  Students  have  traditionally  shared 
their  learning  with  their  teachers.  Using  port- 
folios allows  for  the  inclusion  of  many  other 
stakeholders  in  the  learning  process.  The 


learning  samples  and  reflections  which  are 
integral  parts  of  portfolio  assessment  can  and 
should  be  shared  with  a wide  variety  of  audi- 
ences: peers,  teachers,  parents,  and  other  sig- 
nificant adults.  Peer  responses  can  be 
particularly  powerful.  They  should  be  mod- 
elled, and  should  only  occur  when  an  appro- 
priate comfort  level  exists  in  a class.  Audiences 
can  respond  to  students’  work  orally  (e.g.,  in 
student-led  conferencing)  or  in  writing  (e.g., 
through  structured  parent  or  peer  response 
forms).  Regardless  of  the  format,  interacting 
and  sharing  ideas  and  suggestions  about  stu- 
dents’ work  enriches  the  learning  process  as  a 
wdiole.This  sharing  adds  both  authenticity  and 
meaningfulness  to  students’  learning. 

8.  Setting  Goals 

Setting  specif  ic  goals  near  the  beginning  of  the 
portfolio  process  and  revisiting  these  goals 
periodically  helps  students  to  focus  on  specific 
areas  for  growth.  Students  may  need  guidance 
from  the  teacher  in  setting  goals  that  are 
appropriate — that  is,  achievable  and  yet  chal- 
lenging. Empowering  learners  to  select  their 
own  goals  increases  the  chances  that  students 
will  value  what  they  are  learning  as  they  work 
towards  those  goals.  As  one  student  observed, 
“Setting  goals  for  yourself  helps  you  identify 
your  strengths  and  weaknesses  and  makes  you 
aware  of  them.  Having  personal  goals  also 
gives  you  a strong  sense  of  your. . .capabilities 
and  helps  you  motivate  yourself  to  make  the 
most  out  of  them.”  As  students  set  goals,  teach- 
ers should  work  with  them  to  develop  and 
record  action  plans  that  will  help  them  achieve 
those  goals. 

9.  Evaluation  and  Grading 

Teachers  must  consider  whether  simply  to 
evaluate  students’  portfolios  (i.e.,  judge  them) 
or  whether  to  grade  them  (i.e. , assign  a symbol 
to  that  judgment  for  the  purposes  of  report- 
ing). This  decision  will  depend  on  the  purpose 
for  the  portfolio,  as  well  as  the  grade  level  of 
the  students.  If  a rubric  has  been  established 
early  in  the  process,  students,  teachers  and 
other  audiences  may  use  it  to  evaluate  the  stu- 
dents’ portfolios. Teachers  may  use  those  judg- 
ments in  assuming  final  responsibility  for 
grading  (if  grading  is  a part  of  the  portfolio 
process).  An  essential  guideline  is  that  students 
need  to  know  from  the  very  beginning  who  is 
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is  also  on  the  rise  as  educators  become 
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going  to  evaluate  and/or  grade  the  portfolios 
and  how  this  will  be  done. 

1 0.  Getting  Started  with  Students 

This  area  of  the  Organizer  targets  “tips  and 
dips”  for  getting  portfolios  started  with  your 
students.  Introducing  the  concept  of  portfolios 
by  having  students  bring  in  and  talk  about  their 
favourite  collections,  for  example,  is  a power- 
lul  beginning  for  the  portfolio  process.  A first 
portfolio  entrv  is  often  an  “All  About  Me” 
entry  that  maximizes  student  success  and 
involvement.  “Starting  Small”  is  also  recom- 
mended, es|iecially  for  teachers  v\  ho  are  incor- 
porating portfolio  assessment  into  their 
programs  for  the  first  time.  Working  with 
other  colleagues  who  want  to  explore  portfo- 
lio assessment  also  provides  the  support  and 
dialogue  necessarv  for  working  through  chal- 
lenges and  celebrating  successes. 

The  creation  of  professional  portfolios  is 
also  on  the  rise  as  educators  become  more 
involved  in  directing  their  own  professional 
development  and  documenting  their  perfor- 
mance. The  ten  areas  of  The  Portfolio  Organizer 
that  outline  the  decision  making  required  for 
students’  portfolios  can  also  be  applied  to  the 
devcloj^ment  of  professional  portfolios  (see 
Rolhciser,  Bower  & Stevahn,  2000,  for  elabo- 
ration). VV'hen  teachers  and  students  engage  in 
the  portfolio  process  simultaneously,  many 
exciting  possibilities  emerge  for  co-learning. 

“For  those  who  say  |)ortfolio  assessment  is 
challenging,  time-consuming,  and  complex, 
we  agree;  but  good  teaching  and  learning  are  all 
these  things”  (Rolhciser,  et  al.,  2000,  |x  viii). 
Considering  the  key  areas  outlined  above  will 
help  teachers  to  make  decisions  that  will  work 
lor  them  and  for  their  students.  Ideally,  as 
teachers  become  more  comfortable  with  the 
jirocess  as  a whole,  they  will  involve  students 
in  a great  deal  of  the  decision  making,  and  thev 
will  encourage  the  sharing  of  learning  w ith  as 


many  audiences  as  possible.  This  process  can 
bring  all  the  stakeholders  in  education  togeth- 
er— students,  teachers,  parents  and  adminis- 
trators. Ultimately,  portfolio  assessment  can 
be  a vehicle  through  which  teachers  and  stu- 
dents may  move  from  being  assessment  adver- 
saries to  being  assessment  partners. 

Whether  teachers  are  trying  portfolio 
assessment  for  the  first  time  or  are  retiring 
their  use  of  portfolios  with  students,  it  is 
apparent  that  they  come  to  value  the  many 
w'orthw'hile  learning  experiences  that  are 
inherent  in  the  process.  Portfolio  assessment 
“occupies  an  interesting  in-between  area 
between  the  clean,  artificial  world  of  carefully 
controlled  assessment  (‘Take  out  your  pencils. 
12on’t  turn  over  your  books  until  I say  go’.) 
and  the  sw'ampy  real  world”  (Elbow,  1991 , p. 
xii).  It  is  that  very  “in-betw^een  area”  capturing 
process  and  product  that  many  teachers  find 
exciting  and  appealing.  Ultimately,  portfolios 
are  an  alternative  form  of  assessment  well 
worth  exploring.  Q 

References 

Elbow,  P.  (1991).  In  R,  BelanolT,  & M.  Dickson,  (Eds.),  Portfo- 
lios: Process  and  product.  Portsmouth,  NH:  Hiencmann  Edu- 
cational Book.s. 

Gardner,  H.  ( 1983).  Frames  oJmind:The  tbeorj  multiple  intelli- 
gences. NewYork:  Harper  Collins. 

Rolhciser,  C.,  Bovver,  B.,  & Stevahn,  L.  (2000).  The  portjolio 
organizer:  Succeeding  with  portfolios  in  your  classroom.  Ale,\an- 
dria,  VA:  Association  For  Supervision  and  Curriculum 
Development. 


Barb  Bower  is  an 
English  an(j  Mathe- 
matics teacher  with 
The  Durham  Dis- 
trict School  Board, 
and  is  co-author  of 
The  Portfolio  Orga- 
. nizer:  Succeeding 
^ with  Portfolios  in 
Your  Classroom. 


Carol  Rolheiser  is 
Associate  Dean, 
Ontario  Institute  for 
Studies  in  Educa- 
tion of  the  Universi- 
ty of  Toronto  and 
co-author  of  The 
Portfolio  Organizer: 
Succeeding  with 
Portfolios  in  Your 
Classroom. 


This  book  is 
distingiiished  by 
the  presence  and 
integration  of  a 
conceptual 

framework  and  a superb 
array  of 

practical  examples. 

— Michael  Fullan 


The  Portfolio  Organizer; 
Succeeding  with  Portfolios 
in  Your  Classroom 

by  Carol  Rolheiser,  Barbara 
Bower,  and  Laurie  Stevahn 

ISBN;  0-87 120-374-X 
$24.95  ($20.95  ASCD  members) 

To  order,  contact  ASCD 
at  1-800-933-2723  or 
703-578-9600  or  Web  site: 
http://www.ascd.org 


Section  3 


MAKING  A DIFFERENCE 


Secondary  Schools-A  ^ 
Martian  Chronicle  51 


Testing  the  Big  Ideas 


in  Mathematics 

The  Literacy  Roadmap,  K-1 2 

From  Tiger  to  Anansi 


Secondary  Schools- 
A Martian  Chronicle 
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A popular  joke  some  years  ago  involved  a Martian 
expedition  to  conduct  research  about  schools  on 
Earth.  When  the  expedition  returned  to  Mars,  the 
Martian  leader  asked, “So  what  did  you  discover 
about  hoiv  Earthlings  learn?”“Wcll”  replied  the 
expedition  Ieader,“EarthIings  have  these  buildings 
called  schools.  They  appear  to  be  places  where  young 
Earthlings  travel  everyday  to  watch  old  Earthlings 
work.” 

Tl  he  story  speaks  to  a widely  held  image  of 
teaching  in  which  the  perfect  lesson  is 
viewed  as  a finely  tuned  performance  by 
the  teacher.  If  the  current  secondary  school 
reform  is  to  be  successful,  it  must  be  accompa- 
nied by  a shift  in  teachers’  understanding  of 
their  role.  Specifically,  the  preoccupation  with 
covering  the  curriculum  will  have  to  give  way 
to  a focus  on  the  results  that  students  produce  as 
a consec|uence  of  their  learning.  Put  another 
way,  the  focus  will  have  to  shift  from  what  is 
taught  to  what  is  learned. 

The  difficulties  our  teachers  are  experienc- 
ing as  they  grapple  with  the  issue  of  curriculum 
control  is  well  illustrated  by  initial  research 
into  the  1998-99  pilot  of  the  Millennium  Pro- 
ject. (See  Section  1 of  this  Orbit  issue  where 
Michele  Schmidt  and  Leo  Plue  report  on  their 
study  of  the  pilot  phase  of  this  project. ) 

1 he  Millennium  Project,  which  involves 
Grade  1 1 students  from  schools  in  five  Ontario 
districts,  allows  teachers  and  students  to 
experiment  with  a different  kind  of  learning 
experience.  Students  work  in  small  groups  for 
several  weeks  solving  a real-life  problem  in 
their  school  or  community. The  problems  are 
carelullv  constructed  in  that  thev  include  just 
enough  inlormation  to  suggest  how  students 
should  proceed  w ith  an  investigation  but  never 
enough  information  to  enable  students  to  sobe 
the  jiroblem  without  further  incpiirv.  In 
this  kind  of  learning  experience,  students 
arc  taught  the  curriculum  in  a “just  in  time” 


manner — they  learn  what  they  need  to  learn 
in  order  to  solve  the  problem.  Following  the 
pilot,  a sample  of  teachers  and  students 
was  interviewed  about  the  experience. Their 
responses  are  summarized  below. 

Control  of  Curriculum 

Teachers’  responses  frequently  reilected  their 
reluctance  to  “let  go”  of  their  traditional 
method  of  delivering  the  curriculum.  Although 
the  project  required  students  to  demonstrate 
essential  skills  such  as  the  ability  to  conduct 
independent  research,  to  solve  real-world 
problems,  and  to  communicate  with  adults 
outside  of  school,  one  teacher  stated: 

“1  wouldn’t  do  it  in  an  English  class  where  1 
had  to  take  away  six  weeks  out  of  my  course.” 

The  choice  of  words  used  by  this  teacher  is 
most  significant.  The  notion  of  time  “out  of  my 
course”  redects  the  kind  of  ownership  and  con- 
trol many  secondary  teachers  feel  about  their 
curriculum. This  sentiment  is  echoed  below: 

“The  biggest  problem  was  time. The  project 
took  \ aluable  time  out  of  the  curriculum.  And 
I can’t  imagine  how  you  can  take  20  days  out  of 
your  curriculum.  I don’t  know  how  you  did 
that.” 

Many  teachers  regard  curriculum  as  a body 
of  knowledge,  with  a definable  beginning  and 
ending,  which  has  to  be  “covered”  by  them, 
rather  than  learned  by  their  students.  They 
have  difficulty  seeing  skills  such  as  problem- 
solving, conducting  research  and  communicat- 
ing as  an  essential  part  of  the  curriculum. 

Another  reason  that  secondary  teachers  are 
so  reluctant  to  loosen  their  stranglehold  on  the 
curriculum  is  their  fear  of  not  knowing  all  the 
answers.  As  the  disseminator  of  all  knowledge, 
the  teacher  must  know  all  the  answers.  The 
metaphor  of  the  student  as  the  emptv  vessel  to 
be  filled  by  the  all-knowing  teacher  is  not  easi- 
Iv  relinquished.  As  one  teacher  remarked, 

“I  felt  a bit  inadequate.  I certainly  did  ...  1 


would  have  liked  to  have  had  more  knowledge 
(about  the  subject].” 

As  long  as  teachers’  understanding  of  the 
word  “curriculum”  focuses  primarily  on 
knowledge  acquisition,  then  the  teacher  is 
going  to  feel  compelled  to  know  everything. 
Today,  there  are  such  vastly  superior  sources  of 
knowledge  available  to  students  that  the  role  of 
the  teacher  must  change  accordingly.  Clearly, 
this  will  also  require  a change  in  the  expecta- 
tions students  have  for  their  teachers. 

If  a new  form  of  school  is  to  result  from  Sec- 
ondary School  Reform  initiatic  es,  then  educa- 
tors, and  indeed  the  public  at  large,  will  need 
to  change  their  image  of  the  act  of  teaching  so 
that  the  performer  is  the  student,  not  the 
teacher. 

Control  of  Students 

In  addition  to  needing  to  control  their  curricu- 
lum, many  teachers  also  feel  a need  to  exercise 
control  over  the  actions  of  their  students. 
Another  teacher  involved  in  the  Millennium 
Project  Pilot  remarked, 

“It  was  verv  difficult  to  know  where  stu- 
dents were  at  because  they  were  all  over  the 
school.  Sometimes  they  were  \ isiting  other 
businesses,  and  so  that,  1 think,  w as  a little  bit 
uncomfortable.” 

The  discomfort  that  the  teacher  alludes  to 
stems  from  a mistrust  of  voung  people.Tcach- 
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ers  assume — sometimes  with  good  reason — 
that  if  students  are  not  in  their  sight — that  is, 
in  the  classroom,  sitting  in  rows-  then  they 
will  be  “goofing  off.”  Students  will  not  be 
“doing”  the  curriculum.  Teachers  do  feel, 
as  they  should,  accountable  and  responsible 
for  the  young  people  in  their  charge. The  irony 
is  that  even  when  students  are  sitting  in 
rows  in  the  classroom  watching  the  teacher 
perform,  they  are  often  not  attending  to  the 
curriculum.  For  example,  in  a recent  study,  a 
group  of  senior  students  was  asked  to  keep 
track  of  the  number  of  times  per  class  that 
they  “tune  out.”  Students  identified  five  times 
as  the  average  per  class  (Wakeman-Jones, 
1999). 

And  yet  when  students  do  have  the  opportu- 
nity to  take  charge  of  their  own  learning,  the 
benefits  can  be  significant.  Many  of  the  stu- 
dents involved  in  the  Millennium  Project 
expressed  their  enthusiasm  for  the  engaging 
nature  of  the  real-world  problems  they 
worked  on.  One  teacher  observed: 

“It  just  goes  to  show  how  much  they’re  seek- 
ing non-teacher-directed  things  to  do.  They 
realb'  liked  the  open-endedness.” 

Another  teacher  remarked: 

“I  was  really  pleasantly  surprised  that  1 
almost  never  had  to  talk  to  a group  and  say, 
‘you  know  we’re  supposed  to  be  working  on 
the  Millennium  Project,  you  know  not  ...’. 
AikI  that’s  not  to  say  that  there  weren’t  individ- 
uals that  did  that  but  I think  the  other  members 
of  the  group  would  sort  of  bring  them  back  on 
task  and  get  the  job  done.” 

What  these  obseiwations  indicate  is  that  the 
key  factor  in  promoting  student  learning  is  not 
the  structure  and  control  evident  in  the  typical 
classroom,  but  the  level  of  student  engage- 
ment with  the  learning.  From  an  instructional 
point  of  view,  this  requires  the  teacher  to 
design  opportunities  for  all  students  in  the 
class  to  be  engaged  in  meaningful  learning. 
Many  teachers  complain  that  students  have 
such  short  attention  spans  these  days  because 
they  are  constantly  exposed  to  highly  stimulat- 
ing media.  We  often  hear  teachers  say,  “Kids 
expect  school  to  be  fun,  to  be  entertaining.” 
This  is  not  what  students  demand  of  school. 
But  they  do  demand  engagement;  they 
demand,  consciously  or  otherwise,  to  be 
involved  in  meaningful  work  that  challenges 
them,  and  that  they  see  as  worthw'hile.  And  this 
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Today,  there  are  such  vastly 
superior  sources  of  knowledge  available 
to  students  that  the  role  of  the 
teacher  must  change. 


means  that  they  need  to  be  actively  involved  in 
their  owm  learning,  as  opposed  to  passive 
receivers  of  information.  For  this  to  happen, 
students  must  be  given  far  more  control  over 
their  own  learning. 

A true  standards-based  curriculum  shifts  the 
focus  from  curriculum  coverage  by  the  teacher 
to  a focus  on  all  students  being  required  to  pro- 
duce quality  work.  For  this  type  of  learning  to 
occur,  teachers  need  to  be  both  more  involved 
and  less  involved  with  their  students.  They 
must  be  more  involved  in  terms  of  getting  to 
know'  their  students  as  individuals  so  that  they 
can  exert  more  or  less  control  and  provide 
more  or  less  structure,  depending  on  the  needs 
of  individual  learners. The  outcome  of  this  shift 
leads  to  much  richer  learning.  But  many  sec- 
ondary teachers  have  difficulty  modifying  their 
program  for  individual  students  and  letting  go 
of  their  control  over  the  learning  process. 

Control  Over  Evaluation 

Unfortunately,  letting  go  causes  some  teachers 
to  become  anxious  about  how  they  w'ill  evalu- 
ate achievement.  They  begin  to  reveal  their 
underlying  beliefs  about  the  role  of  the  teacher 
as  evaluator.  Consider  this  statement  by  a 
teacher  involved  in  the  Millennium  Pilot: 

“A  lot  of  it  revolved  around  marks  because 
you  know'  this  is  20  days  out  of  an  English  class, 


and  so  I needed  to  come  up  w'ith  some  marks.” 

Again,  the  language  is  telling.  The  teacher 
does  not  say,  “The  students  needed  opportuni- 
ties to  demonstrate  their  achievement.”  Rather, 
the  notion  is  that  the  teacher  has  to  “come  up 
W'ith  some  marks.”  The  need  to  retain  control 
over  both  the  content  of  the  curriculum  and  the 
time  taken  to  complete  the  course  is  directly 
related  to  teachers’  beliefs  and  practices 
regarding  evaluation  of  student  achievement.  If 
course  content  and  time  are  controlled,  then 
what  students  learn  can  be  easily  quantified. 
Hence  the  preoccupation  of  both  teachers  and 
students  w'ith  marks.  As  long  as  teachers  teach 
the  same  material  to  all  students  in  a clearly 
defined  time  period,  then  evaluation  is  simply  a 
matter  of  measuring  how  much  of  w'hat  was 
taught  has  been  retained  by  each  student. The 
currency  of  achievement  in  the  eyes  of  teacher 
and  students  alike  is  the  numerical  mark.  Part 
of  the  teacher’s  role,  therefore,  is  to  be  the 
accountant,  keeping  a running  tally  of  the  set  of 
marks  for  each  student. 

Rick  Stiggins  has  chronicled  education’s 
preoccupation  w'ith  numbers.  But  he  reminds 
us:  “Not  everything  that  can  be  counted 
counts,  and  not  everything  that  counts  can  be 
counted.” 

Meaningful  and  useful  assessment  does  not 
take  the  form  of  numbers  assigned  by  a judge. 
Imagine  if  a figure  skating  coach  held  up  a sign 
at  the  end  of  a skater’s  practice  routine  which 
said  “4.5.”  This  is  not  helpful  to  the  skater 
when  she  is  trying  to  improve  her  perfor- 
mance. The  coach  and  skater  need  to  collabo- 
rate on  assessing  the  strengths  of  the  routine 
and  the  areas  needing  improvement.  Only 
through  this  shared  understanding  is  the 
skater  able  to  improve  her  performance. 
Eventually,  it  is  necessary  to  assign  a “mark” 
but  this  only  comes  at  the  end  of  the  polished 
performance. 

This  example  highlights  the  difference 
between  “assessment”  and  “evaluation.”  Assess- 
ment should  serve  primarily  to  promote  learn- 
ing, while  “evaluation”  should  inform  students 
and  parents  about  the  quality  of  achievement, 
relative  to  provincial  standards.  Seen  this 
W'ay,  assessment  consists  of  information  to 
the  student  about  how'  to  improve,  w'hereas 
evaluation  consists  of  levels,  letter  grades, 
and/or  percentages  that  rate  the  quality  of 
student  performance. 
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Traditionally,  teachers  have  not  dillerentiatccl 
between  assessment  and  evaluation.  A numeri- 
cal mark  is  assigned  to  everything  that  students 
do,  and  the  cumulative  total  of  these  marks 
ends  up  on  the  report  card.  And  such  is  the 
power  of  the  numerical  mark  that  students  and 
parents  alike  have  accepted  these  numbers  as 
absolute,  particularly  if  at  the  end  of  the 
jrrocess,  the  cumulative  total  is  expressed  to 
two  decimal  j^laces! 

For  significant  reform  to  occur  in  our  sec- 
ondary schools,  the  twin  tyrannies  of  teacher 
control  over  learning  and  the  fixation  with 
numerical  marks  have  to  be  displaced.  The 
naysayers  will  respond  by  saying,  “Unless  I 
mark  cvervthing,  my  students  ^von’t  do  the 
work.”  Such  is  the  power  of  the  self-fulfilling 
prophecy.  We  say,  “Replace  some—  not  all  — 
of  the  marks  students  receive  with  specific 
feedback  on  how  they  can  improve  and  watch 
what  hapi^ens.”  And  we  say  this  because,  to 
continue  with  our  example,  the  ice-skating 
performance  is  ultimately  judged,  but  only 
after  a great  deal  of  diagnostic  and  formative 
assessment  has  occurred  to  enable  the  skater 
to  polish  the  performance  to  a high  standard. 
Again,  collaboration  between  teacher  and  stu- 
dent is  key.  Rather  than  evaluation  being  a 
process  which  the  teacher  performs  on  the 
student  after  the  performance,  teacher  ami 
student  work  together  to  bring  about 
improvement. 

“Kid-watching” 

In  order  to  provide  students  u ith  useful  feed- 
back on  how  to  improve,  teachers  need  to  be 
highly  skilled  observers  and  describers  of  stu- 
dent performance.  Unfortunately,  these  are 
not  skills  that  have  been  required  of  secondary 
teachers  in  the  past. They  were  expected  to  be 
“accountants,”  not  observers. Teachers’  lack  of 


. ..the  kej factor  in  promoting  student 
learning  is  not  the  .structure  and  con- 
trol evident  in  the  tjpical  classroom, 
hut  the  level  of  student  engagement. 


experience  at  “kid-watching”  was  clearly  evi- 
dent amtmg  those  involved  in  the  Millennium 
Project  Pilot.  Most  expressed  discomfort 
with  the  assessment  rubrics  which  had  been 
developed. The  rubrics  addressed  the  essential 
skills  embedded  in  the  tasks;  problem-solving, 
researching  and  communicating.  To  use  the 
rubrics  effectively,  teachers  needed  to 
observe  student  performance  and  then  match 
what  they  saw  with  the  indicators  on  the 
rubrics. 

Observing  students  and  providing  them 
with  useful  feedback  is  a critical  teaching  skill. 
Unfortunately,  much  of  the  air  time  given  to 
Ontario’s  new  “rigorous”  provincial  standards 
has  left  teachers  and  parents  with  the  impres- 
sion that  there  is  no  longer  a place  for  the 
teacher’s  informed  judgement.  Many  people 
are  interpreting  the  standards  to  mean  that 
now,  more  than  ever,  teaching  and  learning 
will  be  quantified.  This  mistaken  belief  is  based 
upon  a fundamental  misunderstanding  that  is 
plaguing  teachers,  administrators  and  program 
staff  across  Ontario  as  they  implement  the  new 
curriculum. 

As  Grant  Wiggins  has  pointed  out,  many 
educators  and  politicians  confuse  “standards” 
with  “standardization.”  Ontario’s  new  stan- 
dards do  not  require  that  across  Ontario,  at  a 
given  moment  on  a given  day,  all  students 
learning  Grade  9 mathematics  will  be  on  the 
same  page  of  the  same  textbook!  Rather  the 
curriculum  standards  (Expectations)  provide 
the  reference  point  to  ensure  that  all  students 
are  taught  essential  skills  and  acquire  essential 
know  ledge.  They  are  a map  but  there  are  many 
possible  routes  by  which  students  might  reach 
the  destination.  The  performance  standards 
(Achievement  Charts)  provide  broad,  com- 
mon reference  points  against  which  students 
are  to  be  evaluated. They  ensure  that  all  stu- 
dents are  held  accountable  for  producing 
quality  work.  However,  a key  feature  of  the 
achievement  charts  is  that  they  recpiire  teach- 
ers to  make  professional  judgments  about  stu- 
dent performance.  If  the  implementation  of 
standards  is  misinterpreted  as  a move  to  stan- 
dardize teaching  and  learning,  then  rather 
than  lessening  their  control  over  the  curricu- 
lum, their  students,  and  evaluation,  teachers 
will  believe  they  need  to  exert  e\  en  greater 
control. The  results  of  such  a move  will  have 


dire  consequences  for  the  quality  of  learning 
for  Ontario’s  students. 

There  is  great  potential  for  the  current 
reform  movement  to  bring  about  significant 
improvement  in  the  qualitv  of  teaching  and 
learning  in  Ontario’s  secondary  schools. 
Unfortunately,  reform  takes  more  than  a set  of 
policy  documents.  It  requires  teachers  to 
objectively  examine  their  current  practice  and 
to  find  in  the  tools  of  reform  good  reasons  for 
changing  what  they  do.  We  have  argued  that 
examining  their  need  to  control  all  aspects  ot 
the  teaching/ learning  process  will  be  neces- 
sary if  significant  change  is  to  occur.  Let  us 
hope  that  if  the  Martian  visitors  were  to  return 
to  Earth  five  years  hence,  they  would  discover 
that  our  secondary  schools  have  indeed  been 
reformed  and  that  they  are  now  places  where 
old  Earthlings  go  everyday  to  watch  young 
Earthlings  work.  O 
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Section 


Making  a Difference 


Testing  the  Big 
Ideas  in  Mathematics 


In  December  2000,  tens  of  thousands  of  stu- 
dents across  Ontario  will  participate  in  the 
Education,  Quality  and  Accountability 
Office’s  (EQAO)  first  survey  test  of  Grade 
9 mathematics. Two  things  are  certain. The  first 
is  that  the  new  Ontario  mathematics  curricu- 
lum for  secondary  schools  will  be  the  “bar” 
used  to  determine  both  the  content  addressed 
and  the  approach  used  in  the  test  instruments. 
The  second  certainty  is  that  the  “bar”  is  high. 

No  one  knows  for  certain  what  questions 
will  be  asked,  but  we  do  have  a fairly  accurate 
vision  of  what  the  Grade  9 test  will  look  like. 
Using  the  provincial  Grade  3 and  6 tests  as  our 
indicators,  we  can  assume  that  the  Grade  9 test 
will  not  be  an  attempt  to  evaluate  students’ 
“glancing  familiarity”  (Gardner,  1999)  with 
hundreds  of  facts,  concepts  and  formulae.  This 
test  will  be  a rich  op|3ortunity  to  measure  what 
we  as  math  educators  truly  value:  the  complex 
web  of  “big  ideas”  that  are  at  the  heart  of  math- 
ematical thinking — reasoning,  modelling, 
problem  solving,  and  communication  using 
multiple  representations. 

Assuming  that  the  Grade  9 test  will  be  con- 
structed in  the  spirit  of  the  Primary  and  Junior 
Division  tests,  it  is  almost  certain  that  students 
will  face  “problematic  situations” — challeng- 
ing and  genuine  dilemmas  that  will  measure 
students’  problem  solving,  conceptual  under- 
standing, aj^plication  of  mathematical  know- 
ledge and  processes,  as  well  as  their  ability  to 
effectively  communicate  all  of  the  above. 
The  design  of  the  test  is  certain  also  to  provide 
empirical  feedback  on  students’  mathematical 
behaviours  such  as  risk-taking,  creativity 
and  tenacity. 

This  type  of  performance-based  assessment 
makes  assumptions  about  the  type  of  instruc- 
tional setting,  the  type  ol  problem  and  the  type 
of  mathematics  that  will  be  the  norm  for  our 
classrooms.  And  so,  now  is  the  time  for  each  of 
us  to  start  thinking  critically  about  what  the 


provincial  test  means  for  our  classroom — 
beginning  with  a discussion  of  the  types  of 
questions  that  it  is  likely  to  ask  and  culminating 
in  how  we  measure  the  very  different  types  of 
products  that  students  may  submit  in  response 
to  those  questions. 

Rich  Assessment  Tasks 

In  order  to  help  classroom  teachers  identify 
potentially  rich  assessment  tasks  for  their  own 
classrooms,  the  following  summary  may  be 
useful.  In  general, “problematic  situations”: 

^ go  beyond  correct  computations 

require  careful  and  thoughtful  investigation 
provide  students  with  an  opportunity  to 
demonstrate  their  ability  to  apply  core 
mathematical  concepts /curriculum  expec- 
tations in  a variety  of  ways — including 
physical  models,  pictures,  graphs,  comput- 
er representations,  or  narratives  supported 
by  computations 

require  students  to  assume  an  active  role  as 
mathematician 

demand  a high  level  of  proficiency  in 
students’  ability  to  communicate  their 
mental  images  of  both  mathematical 
process  and  content 

In  other  words,  rich  assessment  tasks  pro- 
vide opportunities  for  students  to  communi- 
cate their  strategies,  reilcct  on  their  reasoning, 
thoughtfully  evaluate  their  solutions  and 
demonstrate  the  integration  of  various 
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“chunks”  of  knowledge  while  also  requiring 
students  to  organize  many  different  and 
explicit  elements  within  correct  solutions. 
This  is  a far  cry  from  asking  students  to  calcu- 
late the  area  of  rectangles  or  the  volume  of  rec- 
tangular prisms! 

Needless  to  say,  the  test  could  be  quite 
“foreign”  to  Grade  9 students  unless  they 
have  had  many  experiences  in  constructing 
solutions  to  such  qualitatively  different  types 
of  mathematics  problems.  Before  encounter- 
ing rich  assessment  tasks  for  the  first  time 
in  the  formal  setting  of  the  provincial  assess- 
ment, it  is  imperative  that  students  have 
many  opportunities  to  complete  a variety  of 
such  tasks. 

Evaluating  Rich  Assessment  Tasks 

Clearly  such  solutions  cannot  be  marked 
“right”  or  “wrong,”  nor  can  feedback  on  the 
students’  performance  be  accomplished  with  a 
simple  “6  / 1 0”  marked  in  red  pen  on  the  upper 
left-hand  corner  of  the  page.  The  key  to  the 
new  curriculum — and  the  styles  of  student 
assessment  and  evaluation  experiences  it 
embodies — is  that  expectations  are  unambigu- 
ous. Students  are  given  a vision  of  what  excel- 
lence looks  like  as  well  as  the  necessary  skill  set 
required  for  discriminating  between  problem 
types  and  the  range  of  appropriate  responses. 

What  will  be  required  to  evaluate  students’ 
solutions  to  rich  assessment  tasks  is  an  instru- 
ment that  we  can  use  to  judge  the  many  differ- 
ent elements  that  could  be  included  in  a full 
solution. The  best  instrument  for  this  purpose 
is  a comprehensive  scoring  guide  commonly 
known  as  the  rubric.  Any  rubric  has  three  fun- 
damental features:  evaluative  criteria,  quality 
descriptors  and  a scoring  guide.  Rubrics  are 
used  to  assess  significant  demonstrations  in 
which  students  are  called  upon  to  display  high- 
level  skills,  techniques  and  processes  in  an 
authentic  way,  i.e.,  the  task  resembles  a real- 


world  challenge,  is  interesting  (maybe  even 
tun!)  and  rcc|uires  inventive  responses. 

These  Features  ot  rubrics  guide  both  teach- 
ers and  students,  helping  them  to  distinguish 
acceptable  responses  from  unacceptable 
responses,  identify  qualitative  differences  in 
responses  and  make  sense  of  what  a score  value 
means.  Rubrics  are  scoring  tools,  but  they  are 
also  instructional  resources  in  that  the  com- 
munication of  the  criteria  can  illuminate  for 
students  what  essential  mathematical  ideas, 
procedures  and  tools  they  need  to  master. 

The  rubric  that  will  be  employed  by  the 
EQAO  for  the  Grade  9 survey  test  is  likely  to 
strongly  resemble  both  the  one  that  appears  in 
the  official  mathematics  policy  document  and 
those  that  have  been  used  successfully  in  the 
province-wide  Grades  3 and  6 survey  tests.  It 
will  be  based  on  four  levels  of  performance 
(Levels  1 —4,  with  Level  3 (70  — 79%)  being 
the  Provincial  .Standard)  across  domains  such 
as  Knowledge  and  Understanding  of  Mathematical 
Concepts,  Problem  Solving  / Thinking  / Inquiry, 
Applying  Procedures  and  Making  Connections,  and 
Communicating  in  Mathematics. 

Since  a rubric  is  a matrix  which  delineates 
levels  of  performance  as  well  as  the  set  expec- 
tations or  standards  of  achievement,  it  can  be 
used  as  a set  of  “look-fors”  that  a teacher  can 
use  to  place  different  dimensions  of  a solution 
along  a continuum. 

One  dimension  could  lay  out  the  explicit 
elements  that  provide  concrete  evidence  of  the 
student’s  repertoire  of  problem  solving 
processes  and  techniques — that  is,  the  degree 
to  which  the  student  can: 

^ explain  the  task  and/or  restate  the  problem 
identify  the  assumptions,  extract  the 
task(s),  select  relevant  information  or  dis- 
regard extraneous  information 
organize  infonnation  in  effective  and  effi- 
cient ways  (e.g. , choosing  from  tables, 
models,  jtatterns,  spreadsheets) 

^ ^pply  exj^licit  strategies  such  as  estimation, 
applying  an  algorithm,  answering  a simpler 
but  similar  problem,  working  backwards, 
or  acting  out  the  problem  (modelling) 

^ select  an  a|ipropriate  strategy  and  imple- 
ment it  to  find  a correct  solution 
^ state  conclusions  or  generalizations  based 
on  the  solution 

connect  or  apply  the  solution  to  other 


strands  within  mathematics  and  to  other 
domains 

Along  another  dimension,  a carefully  crafted 
rubric  can  provide  the  cues  by  which  teachers 
can  extract  evidence  that  the  student  knows 
and  can  use  the  mathematics  reasoning 
process — that  is,  by: 

>•  making  valid  observations  based  on  avail- 
able data 

recording  data  using  appropriate  formats, 
e.g.,  models,  charts  and/or  graphs 
^ organizing  data  to  illuminate,  describe  and 
extend  patterns 


formulating  generalizations  and  conjec- 
tures based  on  the  data 
validating  the  generalizations  using  logical 
arguments  or  counter  examples 
making  connections  between  known  facts 
and  the  problem  to  be  solved 
validating  her  thinking. 

The  rubric’s  dimensions  can  also  be  used  to 
extract  the  evidence  that  demonstrates  the 
degree  to  which  a student  knows  and  can  use 
the  mathematical  communication  process  by: 

constructing  an  effective  and  efficient  expla- 
nation of  results,  reasoning  and  extensions; 


The  Population  Mystery 


Ingure  1 . A team  of  researchers  has  been  studving  the  population  of  a “mathematical”  bear.  They  have  been 
tracking  bear  families  and  keeping  a record  of  the  number  of  male  cubs  in  each  family.  They  think  that  they 
have  collected  some  rather  odd  findings. To  help  understand  their  data,  they  have  assembled  some  similar 
data  for  bumans.Thev  surveved  a series  of  human  families  with  similar  numbers  of  children  and  made  a 
note  of  the  number  of  bovs.  All  of  the  results  are  shown  above  in  graphical  lorm.  The  researchers  have  con- 
cluded that  the  probabilitv  that  a mother  bear  will  give  birth  to  a male  cub  is  different  from  the  probability 
that  a human  mother  will  give  birth  to  a son. 


Section  4 


55 


Making  a Difference 


No  one  knowsjor  certain  what 


questions  will  be  asked,  but  we  do  have 
a fairly  accurate  vision  of  what  the 
Grade  9 test  will  look  like. 


^ employing  mathematical  terms,  notation 
and  symbols  to  communicate  ideas  and 
thinking 

^ explicitly  linking  multijjle  representa- 
tions — representing  and  connecting  infor- 
mation via  diagrams,  tables,  graphs, 
symbols 

Finally,  the  rubric  can  summarize  the  evi- 
dence that  can  be  used  to  measure  how  well 
the  student  understands  and  makes  connec- 
tions between  core  content/ concepts  by; 

^ giving  appropriate  and  correct  answers  to 
questions  about  key  concepts 
^ successfully  completing  tasks  (e.g. , getting 
correct  answers)  that  require  the  applica- 
tion of  recently  acquired  skills  and  tech- 
niques in  both  familiar  and  novel  situations 
^ clearly  and  convincingly  communicating 
a facility  with  the  content  specified  by 
particular  curriculum  exj^cctations  within 
a strand 

assembling  individual  curriculum  expecta- 
tions into  conceptual,  procedural  or  struc- 
tural constructs  which  can  be  used  to  solve 
complex  problems 

applying  individual  content  items  to  con- 
nect conceptual,  procedural  or  structural 


concepts  between  strands  and  across  disci- 
plines 

^ using  vocabulary  and  concepts  from  other 
disciplines  to  describe  specific  curriculum 
expectations 

What  could  a “rich  assessment  task”  look 
like  on  the  Grade  9 survey  test? 

In  general,  it  is  rare  that  a single  mathematics 
problem,  unless  it  is  exceptionally  designed, 
can  be  assessed  along  multiple  dimensions 
using  multiple  criteria.  Using  the  Grades  3 and 
6 survey  tests  as  the  implementation  model,  it 
follows  that  we  might  find  that  the  investiga- 
tion component  of  the  Grade  9 instruments 
will  be  organized  into  “families”  of  problems 
that  we  can  view  holistically  and  collectively  in 
order  to  obtain  an  accurate  snapshot  of  student 
achievement. 

This  rich  assessment  task  requires  students 
to  solve  a population  mystery  (Figure  1 ). 

Given  statistical  information  about  human 
populations  and  bear  populations  in  the  form 
of  a set  of  graphs,  students  are  required  to 
analyze  the  data  critically  as  presented,  looking 
for  clues  that  will  help  them  to  evaluate  the 
validity  of  a researcher’s  conclusions.  They  are 
asked  to  evaluate  the  relationship  between 
|U'obability  and  statistics  by  applying  proba- 
bilistic arguments  to  interpolate  and  extrapo- 
late values/decisions  from  the  visual  data. 
Finally,  they  address  the  probability  issues  that 
surround  us  daily  by  illustrating  the  impor- 
tance of  justifying  real-world  conclusions 
using  mathematically-defensible  arguments. 
This  particular  “problematic  situation”  is 
designed  to  assess  students’  ability  to  integrate 
skills  from  graphing  (displaying  information) 
with  those  from  statistics  (discussing  data 
numerically)  and  prohahilitj  (the  mathematics 
of  outcomes). 

This  problematic  situation  presents  students 
with  a novel  set  of  information.  The  solution 
rec|uires  that  students  examine  graphical  dis- 
plays through  a qualitative  lens,  looking  for 
symmetry  and  other  patterns  that  can  form 
and  inform  quantitative  arguments. They  must 
use  critical-thinking  techniques  as  they  inter- 
act with  the  role  of  probability  and  statistics  in 
society — in  this  case,  a media  report  about  a 
bear  population.  Students  assess  the  strengths, 
weaknesses  and  biases  of  samples  and  data 


collection  methods;  critique  the  ways  in  which 
the  statistical  information  and  conclusions  are 
presented;  and  evaluate  decisions  based  on 
probability  that  may  be  a combination  of  theo- 
retical calculations,  experimental  results  and 
subjective  judgements. 

In  order  to  solve  this  problematic  situation, 
students  will  need  to  formulate  questions  for 
investigation,  collect  and  display  data,  and  read 
and  interpret  graphs.  They  need  to  perform 
accurate  probability  calculations  using  the 
numerical  definitions  of  probability  (including 
conversions  between  decimal,  percent  and 
fractional  forms),  and  they  require  strategies 
for  listing  all  the  possible  outcomes  for  an 
events  (probability  path,  tree  diagrams). 

The  obvious  difference  between  this  assess- 
ment task  and  traditional  paper-and-pencil  test 
problems  is  that  the  expectations  are  addressed 
completely  within  the  context  of  a large  and 
novel,  applied  problem.  The  test  question  is 
not  so  much  about  answers  as  it  is  about  pro- 
viding students  with  an  opportunity  to  demon- 
strate their  mathematical  knowledge  and 
insights  by  investigation,  exploration,  thought- 
ful justification,  and  making  connections. 

Student  Performances 

Some  students  may  use  a narrative  approach  to 
address  the  family  of  problems.  These  students 
may  describe  how  the  graphs  are  actually 
paired  off  so  that  bear  families  and  human  fam- 
ilies with  the  same  number  of  cubs  or  children 
are  next  to  each  other  on  the  page.  These  same 
students  may  write  that  the  human  graphs 
appear  to  be  more  ‘balanced’ ; whereas  the  bear 
graphs  appear  to  be  ‘lop-sided’  .These  students 
recognize  the  implication  of  the  symmetry  in 
the  graph  of  humans  and  infer  from  the  lack  of 
symmetry  (balance)  that  there  are  more  male 
bear  cubs.  They  may  extend  their  discussion  to 
say  something  really  quite  significant  about 
graphs  and  probabilities  by  stating  that  a sym- 
metrical graph  tells  us  that  there  is  a 50-50 
chance  of  a baby  being  a boy  and  discuss  why  it 
is  likely  that  the  non-symmetrical  shape  of  the 
bears’  graphs  has  caused  the  researchers  to 
question  the  birth  probabilities  for  the  bears. 

These  same  students  may  examine  the 
graphs  more  closely,  noticing  that  the  human 
graphs  have  more  features  than  just 
balance/ symmetry.  Observing  the  “hump”  in 
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The  test  question  is  not  so  much 


about  answers  as  it  is  about  providing 


students  with  an  opportunity  to 


demonstrate  their  mathematical 


knowledge  and  insights 


the  middle,  the  short  bars  off  to  the  ends  and 
the  taller  bars  tow  ards  the  middle,  these  stu- 
dents could  make  comparisons  to  coin  tossing 
ex|)criments  in  which  it  can  be  shown  that 
when  two  coins  arc  tossed,  it  is  common  to  get 
one  head  and  one  tail  more  often  than  either 
two  heads  or  two  tails  and  extrapolate  to  gen- 
der hoy,  girl,  head,  tail.  These  students 
deduce  the  probability  associated  with  a single 
event  From  the  given  distribution  and  explain 
clearly  what  the  physical  configuration  of  the 
graphs  .says  about  birth  probabilities,  generat- 
ing a probability  tree  or  systematic  list  to  sup- 
port and  clarifv  written  explanations. 

Other  students  w ill  examine  the  ejuantita- 
tive  information  contained  in  the  middle 
graphs  that  is,  that  there  were  1 5 bear  fami- 
lies with  no  male  cubs  and  72  human  families 
with  no  male  children.  Thev  will  use  the 
numerical  data  supplied  bv  the  graph  of  male 


bear  cubs  to  make  informed  deductions  about 
the  Female  cub  population. The  bottom  graphs 
tell  us  that  in  Families  with  4 cubs  or  children, 
there  w'erc  3 Families  with  no  male  cubs  and  32 
Families  with  no  boys. They  wdll  Focus  on  how 
the  graph  tells  us  that  there  are  550  families  in 
all  and  that  25%  oF  them  should  have  zero 
boys — that  is,  1 37.5.  The  students  who  use 
this  ajjproach  will  notice  that  in  the  3 cub  Fami- 
lies, there  are  5 1 families  with  three  males,  1 5 
Families  wdth  three  Females  and  1 5 Families 
with  zero  male  cubs. They  will  also  be  able  to 
conclude  that  the  3 cub  Family  graph  tells  us 
that  in  the  71  families  wdth  one  male  cub,  there 
must  be  two  Female  cubs.  They  will  Find  the 
total  number  oFmale  cubs  ( 1 5 Families  w ith 
none,  71  Families  w ith  one,  103  Families  wdth 
two  and  5 1 families  wdth  three)  or  0 + 71  + 
206  +15  3 = 430  male  cubs.  Using  the  Fact  that 
there  are  240  Families  with  three  cubs  each, 
they  can  calculate  the  probability  that  a cub 
will  be  male  is  430/720  or  roughly  60%. 

Whether  a student  initially  took  a qualitative 
or  quantitative  approach,  everyone  will  be 
called  upon  to  identify  some  assumptions 
made  about  the  data-— For  example,  w^ere  the 
bears  all  born  during  the  same  season?  Do 
these  numbers  represent  the  number  oF  bears 
born  or  the  number  of  bears  that  survived  to  a 
certain  age?  Everyone  wdll  be  required  to 
explain  why  there  are  more  male  cubs,  refer- 
ring to  knowledge  From  other  domains — For 
example,  they  wdll  need  to  ask  whether  the 
males  are  hardier  or  whether  the  Females  are 
more  vulnerable  to  predators.  In  conclusion, 
they  will  return  to  mathematics  by  asking 
w'hethcr  the  probability  oFa  mother  having  a 
male  in  the  First  place  is  greater  than  having  a 
female  and  extend  their  solutions  to  compare 
the  reported  distributions  of  bears  to  what  we 
would  expect  if  the  probability  of  genders  w as 
equal. 

Conclusion 

This  “problematic  situation”  w as  selected  to 
illuminate  the  problem-type  that  we  can 
expect  to  encounter  on  the  Grade  9 test  of 
mathematics.  It  shows  us  that  it  is  possible  to 
select  or  create  mathematical  tasks  that  can 
capture  students’  curiosity  w ithout  separating 
mathematical  thinking  From  mathematical 
concepts  and  skills  (NCTM,  1991).  It  empha- 


sizes that  good  tasks  are  challenging  but  within 
reach — that  is,  the  methods  used  to  reach 
answers  are  Familiar  in  other  contexts.  It 
demonstrates  that  rich  assessment  tasks 
require  multiple  perspectives  and  interrelated 
mathematical  ideas.  It  illustrates  that  the  pur- 
pose oF the  problematic  situations  that  students 
will  encounter  on  the  test  is  to  measure  the 
degree  to  which  the  student  can  think  and 
function  independently  oF  the  teacher.  It  also 
emphasizes  that  it  is  time  to  change  how'  w'e 
teach  and  assess  mathematics  now'.  Trying  to 
‘cram’  in  December  won’t  do  it. 

NOTE  :With  sincere  appreciation  to  Peter  Har- 
rison, Mathematics  Coordinator,  Toronto  Dis- 
trict School  Board  For  creating  the  “Bears” 
problem  that  is  central  to  this  article.  Q 
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Making  a Difference 


The  Literacy 
Roadmap,  K-1 2 


Tl  he  purpose  of  the  project,  which  we 
report  on  below,  was  to  assist  teachers  in 
preparing  their  students  for  the  literacy 
component  of  the  Grade  6 assessment. 

A Resource  for  Teachers 

What  support  is  needed  for  teachers  in 
order  to  teach  literacy  skills  ? — Over  the 
course  of  the  last  three  years,  we  have  been 
working  on  a resource  to  address  this  question. 
By  incorporating  the  research  findings  in  the 
fields  of  literacy,  brain-based  learning,  assess- 
ment and  evaluation,  staff  development  mod- 
els, and  our  extensive  experiences  as 
classroom  teachers,  program  consultants  and 
administrators,  we  have  produced  a resource 
that  helps  bridge  the  gap  between  research 
and  classroom  practice.  We  call  this  resource 
“The  Literacy  Roadmap.” 

The  Literacy  Roadmap  consists  of  three  dis- 
tinct divi.sions  (Kindergarten  to  Grade  2;  Grade 
3-6;  Grade  7-12)  and  addresses  all  components 
of  a balanced  literacy  program.  These  divisions 
were  determined  by  reviewing  the  curricular 
expectations  from  across  North  America. 

The  Literacy  Roadmap  is  a process  organi- 
zer, or  a tool,  to: 

^ design  performance-based  tasks 

assess  teacher  competency  and  student 
knowledge  and  skill  level 
design  staff  development 
provide  program  ideas  for  teaching,  prac- 
ticing and  applying  literacy  skills 
There  are  distinct  areas  or  “Information 
Hubs”  within  each  of  the  Roadmaps.  Each  of 
the  hubs  contains  the  elements  that  teachers 
must  teach  and  students  must  learn  within 
each  division. 

Kindergarten  to  Grade  2 / Learning  to 
Read  -The  skills  addressed  within  this  divi- 
sion are  critical  for  literacy  acquisition.  It  is 


here  that  children  acquire  the  skills  necessary 
to  become  Iluent  readers.  These  skills  must 
become  automatic,  allowing  the  reader  to 
spend  less  time  on  the  mechanics  of  reading 
and  more  time  on  understanding  what  has 
been  read. 

Grades  3 to  6 / Reading  to  Learn  — This 
stage  provides  a framework  to  hone  or  practise 
the  skills  taught  in  the  Kindergarten  to  Grade 
2 years.  Students  refine  and  consolidate  the 
mechanics  of  reading  and  writing  as  they  ven- 
ture into  challenging  applications  of  their 
knowledge.  Large  sections  of  the  Kindergarten 
to  Grade  2 Roadmap  have  now  disappeared 
with  the  expectation  that  these  skills  have  been 
consolidated. 

Grades  7 to  12/  Transfer  of  Knowledge — At 
this  stage,  reading  and  writing  become  a tool 
to  express  new  understanding.  Within  this 
division,  students  consolidate  their  thinking 
and  make  connections  between  what  they  have 
read  and  what  they  are  reading.  These  connec- 
tions are  then  used  to  create  new  meanings  . . . 
a new  whole  ...  a new  perspective.  It  is  at  this 
stage  that  the  ability  to  communicate  an  under- 
standing or  apply  higher  order  thinking  skills 
become  critical.  The  curriculum  a,ssumes  that 
students  have  already  consolidated  the 
mechanical  reading  and  writing  skills  neces- 
sary to  allow  for  this  to  happen. 

By  building  the  Roadmaps  and  identifying 
the  integral  parts  of  the  language  curriculum, 
literacy  assessment  tasks  can  be  designed. 
These  tasks  use  the  content  areas  (science  or 
social  studies)  as  the  vehicle  in  which  to  assess 
literacy  skills.  But  the  sole  purpose  of  the 
assessment  task  is  to  assess  “literacy  skills.” 

Using  the  Roadmap 

Designing  theTasks — In  preparation  for  the 
upcoming  assessment,  two  of  our  superinten- 
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dents  gave  us  an  opportunity  to  use  the  Litera- 
cy Roadmap.  The  first  step  was  to  design  a per- 
formance-based assessment  task.  Because  the 
idea  of  performance-based  assessment  is  a rel- 
atively new  concept  for  most  of  our  teachers, 
we  decided  that  they  should  be  involved  in  the 
entire  planning  process. 

Two  teachers  from  seven  school  sites  (lead 
teachers)  were  released  for  a day  to  review  the 
Language  Curriculum  and  to  map  expecta- 
tions (outcomes)  to  the  Literacy  Roadmap. 
They  then  ranked  expectations  by  importance. 
By  identifying  the  importance  of  each  expecta- 
tion, as  it  related  to  the  roadmap,  teachers 
were  then  able  to  identify  the  specific  skills  and 
knowledge  they  must  teach  and  assess. 

The  next  step  was  to  create  a connected 
context  for  the  learning.  The  assessment  could 
not  be  perceived  as  an  “add  on.”  As  “space”  is  a 
science  theme  at  the  Grade  6 level  and  most 
classes  had  either  just  finished  or  were  in  the 
middle  of  this  unit,  the  theme  “Space:  the  Final 
Frontier”  was  chosen. 

Before  introducing  the  task  at  each  site,  time 
was  spent  with  administration  and  support 
staff  outlining  the  expectations  of  the  task.  A 
course  of  action  was  designed  to  meet  the  indi- 
vidual needs  of  each  of  the  seven  sites.  The 
enthusiasm  and  commitment  of  the  adminis- 
trative staff  was  found  to  greatly  influence  the 
acceptance  of  the  task  by  the  faculties.  We  also 
observed  that  this  commitment  seemed  to 
translate  into  higher  student  performance. 

Assessing  the  tasks — After  the  task  was 
administered,  arrangements  were  made  to 
assess  the  tasks.  Principals  released  their  Grade 
6 teams  for  one-half  to  one  full  day  so  that  the 
marking  of  the  tasks  could  be  completed.  To 
assess  the  task,  rubrics  and  checklists  were 
used.  With  guidance,  the  teachers  selected  a 
series  of  anchor  papers  to  match  the  assess- 
ment rubrics. 
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. . . teachers  had  established  a high 

level  oj trust  both  among  themselves 

and  the  project  managers. 

The  group  started  with  pre-selected  train- 
ing papers  (papers  that  we  had  already 
assessed)  and  worked  with  a partner  to  estab- 
lish reliability.  Once  reliability  was  estab- 
lished, the  teachers  independentlv  marked 
their  own  class.  When  questions  surrounding  a 
particular  paper  ensued,  they  did  not  hesitate 
to  ask  a colleague  or  project  manager  tor 
another  opinion.  There  was  no  hesitation  in 
asking  for  assistance. This  behaviour  indicated 
to  us  that  the  teachers  had  established  a high 
level  of  trust  both  among  themselves  and  the 
project  managers.  The  dialogue  was  very 
focused  and  began  to  centre  on  the  questions, 
“How  do  I move  this  child  up  a level  on  the 
rubric?”"  1 know  what  he  can  do,  1 know  what 
he  can’t  do  . . . now  what  do  we  have  to  do?” 
Since  the  task  was  specifically  designed  using 
the  Literacy  Roadmap,  student  limitations 
were  very  easily  identified.  For  example,  ques- 
tion # 1 from  the  task  asked  the  following: 
Using  the  information  from  the  articles 
about  the  astronauts,  make  a list  of  the 
qualities  you  think  are  important  to  become  an 
astronaut, 

(a)  Use  the  attribute  web  to  organize  your 
thinking. 

(b)  List  your  personal  qualities.  Use  an  attribute 
\\eb  to  help  organize  your  thinking. 

(c)  Llsing  the  attribute  webs,  construct  aVenn 
Diagram  to  show  the  differences  and  simi- 
larities between  your  qualities  and  those  of 
an  astronaut. 

(d)  Using  this  information,  write  a letter  to  the 
director  ot  planning  as  to  whether  you  feel 
you  would  or  would  not  be  suited  for  a posi- 
tion on  the  mission.  Make  sure  to  give  vour 
reasons  in  detail. 

The  “thinking  skills"  'assessed  in  question  #1 
were  as  follows: 

Organizing  information 
.Attributing 
Summarizing 
^ Making  judgments 


^ Sequencing 
^ Compare/ Contrast 

The  student  limitations  were  identified  as: 

Did  not  understand  the  concept  of 

“attributes” 

Did  not  understand  the  concept  of 

secjuencing  . . . beginning,  middle  and  end 
LInable  to  transfer  from  graphic  organizer 
to  text  format 

^ Did  not  understand  the  concept  of  com- 
pare/ contrast 

Unable  to  write  supported  opinion 
(In  this  particular  question,  we  did  not  assess 
the  mechanics  of  writing. ) 

During  the  marking  of  the  tasks,  teachers 
remarked  how  easily  they  were  able  to  see  the 
“gaps”  not  only  in  student  performance  but 
also  in  their  own  pedagogical  knowledge  base. 
This  was  the  first  time  teachers  had  worked 
through  an  assessment  in  this  manner. The  pro- 
fessional dialogue  that  ensued  around  the 
assessment  was  substantial.  As  Fullan  (1982) 
has  pointed  out  “it  is  shared  understanding  that 
sustains  an  innovation.” 

Once  the  student  limitations  were  identi- 
fied, a series  of  learning  opportunities  were 
established  to  improve  teacher  knowledge  and 
skill.  With  a “collegial/mentorship”  atmos- 
phere already  established  in  each  school,  it  was 
decided  that  all  schools  would  be  brought 
together  for  specific  training. 

Stajf  Development — Joyce  and  Showers 
(1988)  note  that  “pro\  iding  conditions  that 
enable  teachers  to  engage  in  learning-to-learn 
activities  probablv  means  designing  training 
that  includes  an  explication  of  theory,  multiple 
demonstrations  of  process  and  content  to  be 
mastered  and  opportunities  for  practice  with 
factual,  non-evaluative  feedback.” 

The  model  of  delivery  provided  the  entire 
staff  with  an  opportunity  to  learn  the  new  con- 
cept (acquisition  of  knowledge),  practice  the 
new  concept  (modeling  and  peer  discussion) 
and  apply  the  new  concept  with  non-evaluative 
feedback  (peer  coaching). 

The  staff  development  was  based  upon  the 
results  generated  from  the  assessment  task  and 
the  teach,  practice  and  applv  sections  of  the 
Roadmap. The  following  areas  were  identified 
for  staff  development: 


^ Critical /creative  thinking  skills  and  appli- 
cation 

^ Llsing  cognitive/graphic/structural  orga- 
nizers 

Using  kinesthetic  strategics  to  teach  orga- 
nizational and  sequencing  skills 
^ Critical  reading  strategies 

At  the  writing  of  this  article,  staff  develop- 
ment for  teachers  is  still  ongoing.  The  com- 
ments we  have  received  to  date  have  been 
extremely  positive  from  both  students  and  fac- 
ulty. Priva,  a Grade  6 student,  told  us: 

“I  liked  the  task  because  it  helped  me  think.  1 
don’t  know  why,  but  for  some  reason.  I’d 
rather  do  these  tough  tasks  than  do  the  normal 
stuff  we  usually  do.” 

The  teachers  now  have  a common  focus. 
They  feel  their  planning  is  more  closely  related 
to  the  expectations  of  the  curriculum. They  are 
beginning  to  question  their  own  practice  and 
seek  answers  to  their  questions.  As  Anne,  a 
teacher,  so  aptly  remarked: 

“Now  I know  what  I don’t  know  and  even 
though  it  has  caused  me  some  stress,  at  least 
now  I know  where  I’m  headed... and  I’m 
excited  about  my  new'  learning!”  Q 
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Making  a Difference 


Shelley  Peterson 

From 

Tiger  to  Anansi 


Tl  he  importance  of  personal  voice  and 
ownership  of  one’s  stories  is  communicat- 
ed through  a Jamaican  folktale  Tiger  and 
Anansi  the  Spider  (Johnson,  Sickels,  Sayer, 
& Horovitz,  1977).  Tiger  is  the  all-powerful 
animal  of  the  forest  whose  name  is  identified 
with  the  stories  told  around  the  fire  at  night. 
He  presents  a seemingly  impossible  challenge 
to  Anansi  when  asked  if  the  stories  could  be 
renamed  “Anansi  stories.”  Anansi,  the  smallest 
and  least  powerful  creature,  must  capture 
Snake  alive  and  bring  him  toTiger  within  three 
days!  Unsuccessful  in  his  first  two  attempts  to 
trap  Snake,  Anansi  uses  his  wits  on  the  third. 
Anansi  appeals  to  Snake’s  pride  about  being 
longer  than  the  bamboo  tree  across  the  river. 
Snake  consents  to  being  measured  against  the 
bamboo  tree  as  Anansi  lays  it  out  on  the 
ground.  Unknowingly,  Snake  allows  Anansi  to 
bind  him  to  the  tree. Tiger,  honouring  his  word 
about  the  capture  of  Snake,  declares  that  the 
stories  will  forever  forward  be  called  “Anansi 
Stories.” 

One  way  to  interpret  this  story  is  to  recog- 
nize that  students,  like  Anansi,  need  to  feel  a 
sense  of  ownership  over  their  writing.  They 
need  ample  opportunities  to  write  stories,  let- 
ters, poems,  plays,  reports,  persuasive  argu- 
ments, etc.,  on  topics  that  are  significant  to 
them. The  goals  for  writing  instruction  should 
be  helping  students  to  use  writing  to  make 
sense  of  their  world  and  to  discover  more 
about  themselves,  together  with  the  develop- 
ment of  skills  in  using  particular  genres,  styles 
and  writing  conventions.  Evaluation  methods 
and  criteria  should  rellcct  these  goals,  as  well. 

This  premise  may  sound  idealistic,  and  like 
Tiger’s  challenge  to  Anansi,  seemingly  impos- 
sible to  achieve,  particularly  in  a political  cli- 
mate where  accountability  for  classroom 
instruction  is  measured  by  students’  success  on 
provincial  achievement  tests. The  use  of  stan- 
ilardized  rubrics  and  the  need  to  prepare  stu- 


dents for  a test  that  evaluates  their  writing  in 
terms  of  provincial  standards  are  hardly  com- 
patible with  a desire  to  foster  self-expression 
and  self-discovery  through  writing.  Yet,  like 
Anansi,  who  realized  that  traditional  methods 
for  capturing  animals  would  not  work  for  him, 
we  also  need  to  find  a new  approach  to  writing 
evaluation  in  order  to  develop  students’  writ- 
ing skills  and  at  the  same  time,  encourage  stu- 
dents’ ownership  of  and  commitment  to  their 
writing. 

Often,  a new  a[)proach  comes  to  light  after 
taking  a second  look  at  the  wisdom  of  those 
who  have  gone  before.  In  this  instance,  1 am 
proposing  a re-visioning  of  a framework  that 
Fulkerson  established  in  1979. He  explained 
that  four  philosophies  provide  the  foundations 
for  writing  assessment  and  instruction: 

1 .  formalist  philosophy,  with  an  emphasis  on 
conventions  of  the  written  product,  such  as 
spelling,  punctuation,  and  penmanship; 


One  waj  to  interpret  this  story 


is  to  recognize  that  students,  like 


Anansi,  need  tojeel  a sense  of 


ownership  over  their  writing. 


2.  mimetic  philosophy,  in  which  teachers  are 
intent  on  developing  students’  logic  and  rea- 
soning skills; 

3.  rhetorical  philosophy,  which  is  concerned 
with  achieving  the  desired  effect  on  the  des- 
ignated audience  by  reproducing  features  of 
rhetorical  forms  or  genres;  and 

4.  expressive  philosophy,  which  values  person- 
al meaning  and  self-expression. 

All  of  these  philosophies  make  important 
contributions  to  writing  instruction  and 
assessment. The  first  three  philosophies,  for- 
malist, mimetic  and  rhetorical,  emphasize 
technical  writing  skills  and  conformity  to 
widely  recognized  models  of  good  writing.  The 
expressive  philosophy  diverges  sharply  from 
this  pattern,  as  it  encourages  exploration  and 
diversity.  For  this  reason,  I will  address  its  con- 
tribution to  writing  instruction  and  assess- 
ment separately  from  the  rest. 

Technical  Writing  Skills 

It  can  be  argued  that  current  assessment 
methods  measure  the  aspects  of  writing  that 
are  valued  within  the  formalist,  mimetic 
and  rhetorical  philosophies  with  a satisfactory 
degree  of  objectivity  and  uniformity. 
The  provincial  rubrics  (Ontario  Ministry 
of  Education,  1999)  and  commercially- 
prepared  checklists  reflect  an  accumulation  of 
practical  experience  in  evaluating  student 
writing  and  critical  thought  about  the  ways  in 
which  students  demonstrate  their  writing 
skills  and  knowledge  through  their  written 
products. 

Teaching  within  these  three  philosophies  is 
also  straightforw'ard. Teachers  provide  models 
and  explicitly  describe  characteristics  of  par- 
ticular genres,  strategies  for  developing  logical 
and  reasoned  papers,  and  uses  of  spelling, 
punctuation  and  grammar  rules  in  mini- 
lessons. They  readily  link  assessment  with 
instruction  by  providing  rubrics  or  checklists 
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Student-Teacher  Revision  Conference  Record 


students’ 

NAMES 

DATE 

title/topic 

teacher’s  comments 

Robin 

Oct.l7 

Help!  (Then) 
Safe 

• used  personal  ideas 

• specific  language: 
stumbled,  leading 

• 1 asked  Robin  to  show 
how  Late  was  drawn 
deeper  into  forest.  She  has 
described  Late  as  curious. 
This  may  help  provide 
motivation  for  his  actions. 

with  the  elements  of  writing  that  have  been 
modeled  and  practiced.  In  follow-up  mini- 
lessons, students  and  teachers  might  use  the 
rubrics  and  checklists  to  assess  pieces  written 
by  students  in  another  class  or  in  previous 
classes  taught  by  the  teacher.  In  such  mini- 
lessons,  students  would  learn  to  recognize  the 
elements  of  good  writing  that  are  defined  in 
the  rubrics  and  checklists.  Reinforcement  of 
the  elements  of  good  writing  might  occur  in  a 
student-teacher  conference  during  which  the 
teacher  identifies  examjjles  of  conformity  to 
the  rubric/ checklist  expectations  in  a stu- 
dent’s writing,  together  with  examples  of  par- 
ticular elements  that  are  yet  to  be  masteretl. 
Teachers  might  record  their  observations  dur- 
ing student-teacher  revision  conferences  using 
a template  such  as  the  “Revising  Conference 
Record”  (Petenson,  1998,p.  12). 

To  this  point,  assessment  of  student  writing 
seems  very  tidy  and  elegantly  simple.  Writing 
instruction  and  assessment  that  operates  with- 
in the  formalist,  mimetic  and  rhetorical 
philosophies  allows  students  to  develop  skills 
in  order  to  communicate  their  ideas.  Instruc- 
tion can  be  directed  toward  students’  needs  in 
terms  ol  their  use  ol  writing  conventions,  logic 
and  genres  because  it  is  so  clearly  linked  to 
assessment.  Students  develoj^  as  writers,  and 


designers  of  large-scale  evaluations  of  student 
writing  are  assured  that  they  have  objective, 
reliable  and  valid  tools  for  measuring  that 
development.  Why  stir  in  something  that  will 
complicate  matters? 

Exploration  and  Diversity 

The  answer  to  this  question  brings  us  back 
to  the  expressive  philosophy  of  writing  and 
Anansi’s  tlesire  to  have  a voice  in  the  stories  of 
the  forest.  The  value  of  the  expressive  philoso- 
phy to  writing  instruction  and  assessment  is 
too  great  to  allow  it  to  sit  on  the  sidelines  while 
the  other  three  philosophies  direct  what  hap- 
pens  in  classrooms.  If  students  haven’t  been 
taught  to  explore  and  discover  more  about 
themselves  and  their  world,  and  to  exj^ress 
themselves  to  others,  they  miss  out  on  the 
powerful,  self-satisfying  reasons  for  learning  to 
write  in  the  first  place.  Heard  ( 1995,  p.  4-5) 
states  that  writing  is  “a  place  from  which  one’s 
strength  of  character  is  drawn,  a j^lace  where 
one  feels  at  home.”  She  then  explains  that  “a 
sense  of  where  we  feel  most  at  home  is  a way  of 
keeping  grounded;  it  can  give  us  [a]  sense  of 
rootedness  and  safety.”  While  it  is  unlikely  that 
all  students  will  find  a place  of  strength  in  \^■rit- 
ing,  it  is  very  likely  that  they  can  use  writing  as 
a tool  to  discover  more  about  ^vhere  their  per- 


sonal places  of  strength  might  lie.  Further- 
more, in  order  for  students  to  feel  committed 
to  improving  the  features  of  writing  (use  of 
writing  conventions,  elements  of  various  gen- 
res and  reasoning  skills)  that  are  evaluated  in 
rubrics,  they  must  find  writing  personally 
meaningful  and  have  a sense  of  ownership  over 
their  writing. 

Grounded  in  formalist,  mimetic  and  rhetor- 
ical philosophies,  current  writing  evaluation 
assumes  the  existence  of  a universal  standard 
of  writing  (Purves,  1 99 1 ; Schwegler,  1991) 
and  that  fairness  and  consistency  are  possible 
only  when  using  evaluation  tools  that  reflect 
this  universal  standard. There  is  growing  evi- 
dence, however,  that  fairness  and  consistency 
in  current  writing  evaluation  practices  arc  illu- 
sory. Gender  patterns  in  the  large-scale  evalua- 
tion of  student  writing  have  existed  over  time 
and  across  international  borders  (Alberta  Edu- 
cation, 1995;  Applebee,  Langer  & Mullis, 
1986;  Stobart,  Elwin  & Quinlan,  1992). 
Repeatedly,  girls’  writing  receives  higher 
scores  than  boys’  writing.  Eurthermore,  my 
research  (Peterson,  1998)  shows  that: 

1 . gender  disparities  may  be  attributed  to  a 
narrow  definition  of  good  writing  rather 
than  to  inadequacies  in  male  students’  writ- 
ing competencies  and  motivation  to  write; 
and 

2.  assessment  practices  emphasizing  conformi- 
ty over  self-expression  overlook  the  influ- 
ence of  cultural  expectations  on  writing 
assessment  and  perpetuate  gender  dispari- 
ties in  writing  success. 

Teachers  in  my  study  talked  about  girls’ 
writing  in  more  favourable  terms  than  they  did 
boys’  writing.  Their  scoring  of  one  story,  writ- 
ten by  a girl  in  a style  that  exemplified  both 
female  and  male  characteristics,  was  signifi- 
cantly higher  when  teachers  perceived  the 
writer  to  be  a girl.  Both  studies  showed  that 
current  evaluation  practices  that  involve  com- 
paring students’  writing  to  a widely  recog- 
nized standard  does  not  ensure  equity  and 
validity. 

Introducing  these  personal  and  social 
dimensions,  expressive  philosophy  moves 
writing  assessment  into  a more  fluid  and  less 
tidy  realm  than  that  of  the  formalist,  mimetic 
and  rhetorical  philosophies.  If  we  truly  want  to 
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Assessing  student  writing  in  ways 


that  value  self-expression  as  well  as 


conformitj  to  writing  conventions 


is  a complex  challenge. 


assess  students’  writing  development  as  holis- 
tically and  fairly  as  possible,  however,  we  must 
consider  how  writing  assessment  can  accom- 
modate student  writers’  need  to  express  their 
individuality  and  at  the  same  time  recognize 
the  need  for  conformity  to  conventions 
in  order  to  communicate  that  uniqueness  to 
others. 

Initial  steps  toward  incorporating  all  four 
philosophical  approaches  in  writing  assess- 
ment might  involve  adding  assessment  cate- 
gories such  as  “Expression  of  Individuality”  and 
“Creativity/ Presenting  New  Ways  ofThinking 
About  a Topic”  to  the  existing  rubrics  and 
checklists.  Within  these  categories,  specific 
criteria  might  include: 


Thfj  Wire  Aitist  Je'A'Hler  d Canadian 
montfily'.  teachB?.  hasi<-;/advaria;J  projfjcts. 
iliustratod  and  doscribtd  in  great  tielail. 

Listed  in  EBSCO  Librarians’  Handbook. 

For  information: 

Phone:(519)461-1902  E-mail: 
mag@wag.on.ca 
Website:  www.wag.on.ca 


1 . includes  details  from  personal  experience/ 

interests  / thoughts  / feelings 

2.  uses  language/ideas  that  reflect  student’s 

interests  and  personality 

3 . presents  a new  twist  on  a familiar  topic/ idea 

4.  experiments  with  new  ideas 

Students’  self-assessment  is  an  important 
element  of  more  comprehensive  writing 
assessment  practice.  Students  might  use 
checklists  or  write  comments  identifying  the 
unique  twists  on  familiar  ideas  that  they 
expressed  in  their  writing  and  the  parts  of 
their  writing  that  they  feel  express  their  per- 
sonality. They  might  also  look  at  those  parts 
that  give  students  the  greatest  pleasure  to  cre- 
ate, those  that  reflect  a new  discovery  about 
themselves  or  their  world,  and  those  that 
reflect  students’  experimentation  with  new 
ideas.  By  asking  students  to  consider  these 
aspects  of  writing  in  their  assessment  of  their 
writing,  we  present  writing  as  a creative, 
expressive  act.  We  also  show  that  the  expres- 
sion of  students’  individuality  is  as  at  least  as 
important  as  conforming  to  standards  estab- 
lished in  the  rubrics  that  are  based  on  formal- 
ist, mimetic  and  rhetorical  philosophies  of 
writing  instruction  and  assessment . 

Assessing  student  writing  in  ways  that  value 
self-expression  as  well  as  conformity  to  writ- 
ing conventions  is  a complex  challenge.  Tike 
Anansi’s  struggle  to  capture  Snake  alive,  this 
challenge  requires  thinking  outside  the  tradi- 


tional approaches. 

The  ideas  I have  presented  in  this  article  are 
an  initial  step  in  this  process.  Many  more  con- 
versations about  the  role  of  writing  in  stu- 
dents’ lives  within  and  beyond  the  classroom 
and  the  ways  in  which  writing  assessment  rein- 
forces this  role  must  take  place  if  we  are  to 
meet  this  challenge.  lil 
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Lloyd  M.  Dunn  and  Leota  M.  Dunn  (1997)  • This  individually  administered,  norm-referenced 
instrument  is  a measure  of  listening  comprehension  for  spoken  words  in  standard  English  and 
a screening  test  of  verbal  ability  for  ages  2.6  to  90+.  Complete  Kit  $250.00 

WOODCOCK  READING  MASTERY  TEST-REVISED  (WRMT-R) 

Richard  W.  Woodcock  (1998)  • An  individual  assessment  of  reading  skills  for  children  and 
adults,  ages  5-0  to  75+.  Complete  Kit  $442.00 
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RECENT  ORBIT  ISSUES 
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Education  and  the  Soul 
Guest  Editors:  Dave  Hunt  and 
John  P.  (Jack)  Miller 
This  issue  is  a celebration  of  soul,  an 
affirmation  of  its  central  place  in  our 
lives  with  a special  emphasis  on  soul 
in  education.  This  emphasis 
includes  nurturing  the  souls  of 
teachers  and  learners— students  of 
all  ages.  Special  feature:  Interview 
with  Thomas  Moore.  ‘ 

Story  Matters:  The  Role  of  Story 
in  School  . 

Guest  Editor:  David  Booth 
From  an  early  age  stories  play  an  I 
important  role  in  our  lives.  Stories 
matter  because  they  include 
perspectives,  aspirations  and 
dreams.  Emphasis  on  howto 
create  classroom  and  school 
environments  which  recognize 
and  draw  on  the  power  of  stories. 


The  New  Face  of  Teaching 
Guest  Editors:  Carol  Rolheiser  and 
Kim  Gordon 

The  new  face  of  teaching  is  not 
afraid  of  accountability,  of  higher 
standards,  or  of  an  increasingly  chal- 
lenging student  population.  The  new 
face  of  teaching  wants  what  every 
generation  of  teachers  has  always 
wanted— to  make  a difference  in  the 
lives  of  students.  The  authors  in  this 
Orbit  issue  offer  learning  strategies 
for  teachers  that  will  help  them 
make  this  difference.  Special 
emphasis  on  new  teachers. 

Safe  Schools  ‘99 
Guest  Editor:  Stu  Auty 
This  Orbit  issue  is  a unique,  indepth 
document  on  the  challenges  facing 
educators  who  want  to  create  and 
maintain  safe  schools.  Features 
up-to-date  research,  basics  of  a 
comprehensive  approach, 
strategies  to  reduce  violence. 
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